00000001:02000400:0.0F:1788581054.995231:0:3293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788581066.564795:0:3495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788581068.478499:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 529 MB/s 00000001:01000000:3.0F:1788581068.728370:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 859 MB/s 00000001:01000000:2.0F:1788581068.978703:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5199 MB/s 00000020:02000000:2.0:1788581069.802592:0:3587:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g3d8212a 00000400:02000000:1.0F:1788581070.639959:0:3602:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.103@tcp [8/256/0/180] 00008000:02000000:2.0:1788581073.950707:0:3751:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788581130.317056:0:5720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788581144.151334:0:6470:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581144.151341:0:6470:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788581144.151342:0:6470:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788581144.151508:0:6470:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003c6b8884 00000080:02000400:2.0:1788581144.151519:0:6470:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788581144.159697:0:6470:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788581144.159711:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788581144.159740:0:6470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a4b56a31) 00000020:00000080:2.0:1788581144.159758:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788581144.222994:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788581144.223080:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788581144.242816:0:6470:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788581144.242989:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788581144.242995:0:6470:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788581144.243005:0:6470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f662 00000020:01000004:1.0:1788581144.243010:0:6470:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788581144.243014:0:6470:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788581144.243018:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c6b8884 from MGS 00000020:01000004:1.0:1788581144.243021:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788581144.243036:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008942fa18) 00000020:00000080:1.0:1788581144.243044:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788581144.243100:0:6470:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c6b8884 from MGS, refs=2 00080000:01000000:1.0:1788581144.243104:0:6470:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581144.243109:0:6470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f670 00000100:00100000:1.0:1788581144.243196:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788581144.243575:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788581144.243580:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788581144.244697:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788581144.244707:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788581144.245863:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581144.246053:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788581144.246059:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788581144.248567:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788581144.248579:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788581144.248995:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788581144.249004:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788581144.249721:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581144.249724:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581144.249726:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581144.249964:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581144.249966:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581144.249968:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581144.250677:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788581144.257727:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788581144.500360:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4547 MB/s 00000001:01000000:0.0:1788581144.750462:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6923 MB/s 00000001:01000000:2.0:1788581145.003823:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 770 MB/s 00000001:01000000:2.0:1788581145.253472:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 507 MB/s 00080000:10000000:2.0:1788581145.259846:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788581145.274134:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788581145.279377:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:1.0:1788581145.283429:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788581145.283497:0:6470:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788581145.283559:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788581145.283781:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788581145.283808:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788581145.284453:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581145.284648:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788581145.284656:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788581145.286773:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788581145.286786:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788581145.289674:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788581145.289687:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788581145.290241:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788581145.290430:0:6470:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:1.0:1788581145.290432:0:6470:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788581145.290527:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:1.0:1788581145.290541:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (00000000349eb484) 00000020:00000080:1.0:1788581145.290559:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788581145.290878:0:6470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000286b9a34@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581145.291046:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:1.0:1788581145.291053:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788581145.291313:0:6489:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788581145.292767:0:6490:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788581145.292804:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid a41bfcf2-194f-415a-ba31-00ecb4f1e60f) 00000020:00000080:1.0:1788581145.292821:0:6470:0:(genops.c:1385:class_connect()) connect: client a41bfcf2-194f-415a-ba31-00ecb4f1e60f, cookie 0x50f0cc74b7b2f67e 00000100:00080000:1.0:1788581145.292831:0:6470:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581145.292835:0:6470:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import 00000000286b9a34 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581145.292874:0:6470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ed9883f3 x1875463184056448/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581145.292893:0:6470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS 00000100:00100000:0.0:1788581145.293146:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed9883f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184056448:0@lo:250: 00000020:01000004:1.0:1788581145.294469:0:6470:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788581145.294478:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788581145.294495:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c6870206) 00000020:00000080:1.0:1788581145.294516:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788581145.297616:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581145.299184:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184056448 00000100:00100000:2.0:1788581145.299209:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184056448 00000100:00100000:2.0:1788581145.299329:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581145.299338:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1875463184056448:12345-0@lo:250: 00010000:00080000:2.0:1788581145.299379:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a41bfcf2-194f-415a-ba31-00ecb4f1e60f@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:2.0:1788581145.299416:0:6486:0:(genops.c:1385:class_connect()) connect: client a41bfcf2-194f-415a-ba31-00ecb4f1e60f, cookie 0x50f0cc74b7b2f68c 00000100:00080000:2.0:1788581145.299591:0:6486:0:(import.c:65:import_set_state_nolock()) 00000000ef5cec95 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581145.299671:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:3617:x1875463184056448:12345-0@lo:250: Request processed in 333us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.299679:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581145.299767:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788581145.299778:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1788581145.299786:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788581145.299791:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788581145.299793:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000286b9a34 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788581145.299795:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788581145.299802:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788581145.299807:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed9883f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184056448:0@lo:250: 00000100:00100000:1.0:1788581145.311642:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581145.311959:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581145.311966:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788581145.314347:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788581145.314361:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788581145.314962:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581145.314969:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788581145.315862:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581145.316053:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788581145.316057:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788581145.316705:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788581145.316714:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788581145.344870:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581145.345052:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788581145.345059:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788581145.346022:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788581145.346029:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788581145.346817:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581145.347027:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788581145.347032:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788581145.347756:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581145.347764:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788581145.348507:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581145.348676:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581145.348681:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788581145.349193:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581145.349200:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788581145.349875:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581145.350020:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581145.350024:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788581145.350852:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581145.350861:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788581145.365388:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581145.365615:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581145.365622:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788581145.366803:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581145.366813:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788581145.368926:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581145.368939:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788581145.369872:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788581145.369898:0:6470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788581145.369903:0:6470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788581145.369992:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788581145.370023:0:6470:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788581145.370027:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788581145.370029:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581145.370030:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581145.370031:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581145.370032:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581145.370033:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581145.370034:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581145.370035:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581145.370037:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581145.370038:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581145.370039:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581145.370040:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581145.370042:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788581145.370044:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581145.370049:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581145.370050:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581145.370050:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581145.370051:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581145.370052:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581145.370053:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581145.370054:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581145.370054:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581145.370055:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581145.370056:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581145.370057:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581145.370090:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788581145.370104:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a5bb71e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056576:0@lo:253: 00000100:00100000:2.0:1788581145.370448:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581145.370526:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1b43442 going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.370586:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184056576 00000100:00100000:0.0:1788581145.370593:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184056576 00000100:00100000:0.0:1788581145.370675:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581145.370683:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004288c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6470:x1875463184056576:12345-0@lo:253: 20000000:01000000:0.0:1788581145.370720:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788581145.370723:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788581145.370981:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788581145.371028:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788581145.371328:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581145.372452:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788581145.372646:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788581145.372650:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788581145.372655:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788581145.372658:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788581145.372670:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788581145.372860:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581145.373036:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788581145.373048:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788581145.373063:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788581145.373076:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788581145.373087:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788581145.373518:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788581145.373529:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788581145.373542:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788581145.373546:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788581145.373556:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788581145.373560:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788581145.373572:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788581145.373584:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788581145.373626:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788581145.373632:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788581145.373640:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581145.373740:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788581145.373749:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788581145.373761:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788581145.373774:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788581145.373786:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788581145.373792:0:6488:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788581145.373813:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788581145.373819:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788581145.373836:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788581145.373849:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788581145.373861:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788581145.373868:0:6488:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788581145.373887:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788581145.373893:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788581145.373904:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788581145.373919:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788581145.373986:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788581145.374006:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788581145.374012:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788581145.374730:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788581145.374902:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788581145.374920:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:2.0:1788581145.374922:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788581145.374936:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788581145.374942:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788581145.374956:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788581145.374962:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1788581145.374974:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788581145.374981:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788581145.374995:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788581145.375024:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788581145.375052:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788581145.375055:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788581145.375058:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788581145.375095:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581145.375098:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788581145.375621:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788581145.375765:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788581145.375784:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788581145.375799:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788581145.375808:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788581145.375815:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788581145.376033:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788581145.376166:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788581145.376186:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788581145.376200:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788581145.376221:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581145.376224:0:6488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788581145.376227:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788581145.376229:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788581145.376233:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788581145.376238:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788581145.376661:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788581145.376751:0:6488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788581145.383727:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788581145.383765:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788581145.383779:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788581145.383795:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788581145.383824:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383840:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383849:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383854:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383860:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383866:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383887:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000034a9e41a already unused, calling callback (00000000b3b830f6) 00010000:00010000:2.0:1788581145.383891:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383898:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383911:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383918:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.383924:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034a9e41a/0x50f0cc74b7b2f693 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581145.383942:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788581145.392022:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004288c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6470:x1875463184056576:12345-0@lo:253: Request processed in 21332us (21566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.392038:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581145.392510:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a5bb71e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056576:0@lo:253: 10000000:01000000:1.0:1788581145.392527:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788581145.392530:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581145.392532:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788581145.392534:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581145.392535:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788581145.392536:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581145.392537:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581145.392539:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581145.392540:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788581145.392541:0:6470:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788581145.392542:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581145.392544:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581145.392624:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c6b8884 from lustre-MDT0000 10000000:01000000:2.0:1788581145.392654:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788581145.392657:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581145.392661:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff995e7557cd28 10000000:01000000:2.0:1788581145.392665:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581145.392673:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7557cd28 from 1 10000000:01000000:2.0:1788581145.392676:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581145.392711:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.392736:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.392744:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581145.392761:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056704:0@lo:101: 00000100:00100000:2.0:1788581145.392794:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581145.392923:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb5ca33f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.392964:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184056704 00000100:00100000:0.0:1788581145.392976:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184056704 00000100:00100000:0.0:1788581145.393044:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581145.393053:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024127405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6470:x1875463184056704:12345-0@lo:101: 00010000:00010000:0.0:1788581145.393064:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581145.393076:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f69a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.393097:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.393106:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.393128:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df875ba3, rc 0) 00000100:00100000:0.0:1788581145.393207:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024127405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6470:x1875463184056704:12345-0@lo:101: Request processed in 155us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.393222:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581145.394369:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056704:0@lo:101: 00010000:00010000:3.0:1788581145.394400:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.394410:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581145.394496:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056832:0@lo:501: 00000100:00100000:3.0:1788581145.394548:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.394607:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006576c1f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.394703:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184056832 00000100:00100000:0.0:1788581145.394709:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184056832 00000100:00100000:0.0:1788581145.394749:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581145.394757:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae0d99e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6470:x1875463184056832:12345-0@lo:501: 00000100:00100000:0.0:1788581145.394841:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae0d99e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6470:x1875463184056832:12345-0@lo:501: Request processed in 85us (293us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581145.394848:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581145.394965:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056832:0@lo:501: 10000000:01000000:3.0:1788581145.394988:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788581145.395003:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395010:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581145.395018:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e4eb3a800 10000000:01000000:3.0:1788581145.395022:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788581145.395026:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e4eb3a800 10000000:01000000:3.0:1788581145.395028:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788581145.395031:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e4eb3a800 from 1 10000000:01000000:3.0:1788581145.395034:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788581145.395055:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395062:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395069:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581145.395080:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056960:0@lo:101: 00000100:00100000:3.0:1788581145.395104:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.395121:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006576c1f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.395167:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184056960 00000100:00100000:0.0:1788581145.395171:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184056960 00000100:00100000:0.0:1788581145.395199:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581145.395204:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e62cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6470:x1875463184056960:12345-0@lo:101: 00010000:00010000:0.0:1788581145.395212:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581145.395230:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf551736/0x50f0cc74b7b2f6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f6a8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395245:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf551736/0x50f0cc74b7b2f6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6a8 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395288:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf551736/0x50f0cc74b7b2f6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6a8 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395295:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf551736, rc 0) 00000100:00100000:0.0:1788581145.395321:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e62cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+7:6470:x1875463184056960:12345-0@lo:101: Request processed in 118us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.395326:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581145.395414:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184056960:0@lo:101: 00010000:00010000:3.0:1788581145.395430:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395436:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581145.395446:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788581145.395458:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395464:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000002139c406/0x50f0cc74b7b2f6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581145.395470:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788581145.395473:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581145.395477:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e4eb3a800 10000000:01000000:3.0:1788581145.395479:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788581145.395481:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788581145.395483:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788581145.395495:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395500:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395505:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581145.395515:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057088:0@lo:101: 00000100:00100000:3.0:1788581145.395537:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.395558:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006576c1f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.395602:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057088 00000100:00100000:0.0:1788581145.395606:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057088 00000100:00100000:0.0:1788581145.395662:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581145.395669:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d42d470e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+7:6470:x1875463184057088:12345-0@lo:101: 00010000:00010000:0.0:1788581145.395676:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581145.395684:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f6b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395696:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395701:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581145.395707:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ccaa6fc, rc 0) 00000100:00100000:0.0:1788581145.395733:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d42d470e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+8:6470:x1875463184057088:12345-0@lo:101: Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.395745:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581145.395939:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057088:0@lo:101: 00010000:00010000:3.0:1788581145.395949:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.395956:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581145.395994:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057216:0@lo:501: 00000100:00100000:3.0:1788581145.396017:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.396068:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006576c1f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.396101:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057216 00000100:00100000:0.0:1788581145.396105:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057216 00000100:00100000:0.0:1788581145.396121:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581145.396125:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007594b508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+8:6470:x1875463184057216:12345-0@lo:501: 00000100:00100000:0.0:1788581145.396212:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007594b508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6470:x1875463184057216:12345-0@lo:501: Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.396218:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581145.396290:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057216:0@lo:501: 00000100:00100000:3.0:1788581145.396311:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057344:0@lo:503: 00000100:00100000:3.0:1788581145.396343:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.396357:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006576c1f going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.396421:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057344 00000100:00100000:0.0:1788581145.396425:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057344 00000100:00100000:0.0:1788581145.396439:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581145.396443:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd540573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6470:x1875463184057344:12345-0@lo:503: 00000100:00100000:0.0:1788581145.396514:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd540573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6470:x1875463184057344:12345-0@lo:503: Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.396520:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581145.396575:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057344:0@lo:503: 00000100:00100000:2.0:1788581145.396945:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6515:1875463184057472:0@lo:502: 00000100:00100000:2.0:1788581145.396977:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581145.397002:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068f9e001 going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.397036:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057472 00000100:00100000:0.0:1788581145.397039:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057472 00000100:00100000:0.0:1788581145.397063:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581145.397068:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005cd9b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6515:x1875463184057472:12345-0@lo:502: 00000100:00100000:0.0:1788581145.397136:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005cd9b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6515:x1875463184057472:12345-0@lo:502: Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.397142:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581145.397219:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6515:1875463184057472:0@lo:502: 00000020:01000000:3.0:1788581145.397240:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581145.397249:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581145.397251:0:6515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581145.397293:0:6515:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788581145.397307:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581145.397327:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001da2e475) 00000020:00000080:3.0:1788581145.397341:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788581145.397346:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581145.397474:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788581145.397480:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f6cb 00000020:00000080:3.0:1788581145.397683:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581145.397692:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581145.397695:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581145.397696:0:6515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581145.397698:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581145.397702:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581145.397703:0:6515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788581145.397705:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581145.397710:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004834429a) 00000020:00000080:3.0:1788581145.397718:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788581145.397721:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788581145.397723:0:6515:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788581145.397725:0:6515:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788581145.397730:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581145.397781:0:6515:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c6b8884 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788581145.397791:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c8b5988e) 00000020:00000080:3.0:1788581145.397798:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788581145.398005:0:6515:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788581145.398010:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2f6e0 00000020:00000080:3.0:1788581145.398102:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788581145.398108:0:6515:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788581145.398112:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x50f0cc74b7b2f6e7 00080000:01000000:3.0:1788581145.398116:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788581145.398119:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f6ee 00080000:10000000:3.0:1788581145.398965:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788581145.399108:0:6515:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788581145.403165:0:6515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788581145.453230:0:6515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788581145.453609:0:6515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788581145.455984:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788581145.456368:0:6515:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788581145.458592:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a29295bf) 00000020:00000080:2.0:1788581145.458612:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788581145.458690:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788581145.458697:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f6fc 00000020:00000080:2.0:1788581145.464607:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788581145.465548:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.468161:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.470470:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.472187:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.473967:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.475609:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788581145.477631:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x50f0cc74b7b2f703 00000020:00000080:2.0:1788581145.478003:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788581145.478013:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581145.478019:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581145.478021:0:6515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788581145.478024:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581145.478028:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581145.478029:0:6515:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581145.478031:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581145.478033:0:6515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581145.478035:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581145.478037:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581145.478038:0:6515:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581145.478040:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581145.478044:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581145.478045:0:6515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788581145.478047:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788581145.478088:0:6515:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788581145.478143:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6a4d60f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6515:1875463184057600:0@lo:502: 00000100:00100000:2.0:1788581145.478221:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581145.478341:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3cbf100 going to sleep for 11 seconds 00000100:00100000:0.0:1788581145.478451:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057600 00000100:00100000:0.0:1788581145.478459:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057600 00000100:00100000:0.0:1788581145.478529:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581145.478537:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e118c291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6515:x1875463184057600:12345-0@lo:502: 00000100:00100000:0.0:1788581145.478651:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e118c291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6515:x1875463184057600:12345-0@lo:502: Request processed in 114us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581145.478663:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581145.478727:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6a4d60f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6515:1875463184057600:0@lo:502: 00000020:01000000:3.0:1788581145.478752:0:6515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581145.478757:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581145.478759:0:6515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788581145.478762:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788581145.478926:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788581145.478946:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788581145.478961:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.478972:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581145.478979:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3a800 from 1 10000000:01000000:1.0:1788581145.478982:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581145.479018:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.479030:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.479039:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.479053:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057728:0@lo:101: 00000100:00100000:1.0:1788581145.479089:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.479283:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.479430:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057728 00000100:00100000:2.0:1788581145.479436:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057728 00000100:00100000:2.0:1788581145.479462:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581145.479468:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd31dca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:6470:x1875463184057728:12345-0@lo:101: 00010000:00010000:2.0:1788581145.479476:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581145.479487:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f70a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.479506:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.479527:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.479534:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059b081c7, rc 0) 00000100:00100000:2.0:1788581145.479562:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd31dca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:6470:x1875463184057728:12345-0@lo:101: Request processed in 95us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.479567:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581145.479692:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057728:0@lo:101: 00010000:00010000:1.0:1788581145.479702:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.479711:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.480291:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057856:0@lo:256: 00000100:00100000:1.0:1788581145.480337:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.480364:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.480493:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057856 00000100:00100000:2.0:1788581145.480499:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057856 00000100:00100000:2.0:1788581145.480524:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581145.480529:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000151239a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:6470:x1875463184057856:12345-0@lo:256: 20000000:01000000:2.0:1788581145.480542:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788581145.480546:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788581145.480610:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000151239a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:6470:x1875463184057856:12345-0@lo:256: Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.480617:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581145.480730:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057856:0@lo:256: 10000000:01000000:1.0:1788581145.481357:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581145.481418:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.481427:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581145.481449:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3a800 from 1 10000000:01000000:1.0:1788581145.481452:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581145.481475:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.481481:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.481488:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.481501:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057984:0@lo:101: 00000100:00100000:1.0:1788581145.481535:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.481568:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1788581145.481692:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184057984 00000100:00100000:3.0:1788581145.481705:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184057984 00000100:00100000:3.0:1788581145.481741:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581145.481747:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009093a01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:6470:x1875463184057984:12345-0@lo:101: 00010000:00010000:3.0:1788581145.481756:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581145.481769:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f718 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.481786:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.481795:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.481802:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e983346c, rc 0) 00000100:00100000:3.0:1788581145.481954:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009093a01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184057984:12345-0@lo:101: Request processed in 207us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581145.481960:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581145.482021:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184057984:0@lo:101: 00010000:00010000:1.0:1788581145.482031:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.482038:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.482085:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058112:0@lo:501: 00000100:00100000:1.0:1788581145.482158:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.482179:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.482234:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058112 00000100:00100000:2.0:1788581145.482238:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058112 00000100:00100000:2.0:1788581145.482274:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581145.482280:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007612133f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184058112:12345-0@lo:501: 00000100:00100000:2.0:1788581145.482424:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007612133f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184058112:12345-0@lo:501: Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.482431:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581145.482520:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058112:0@lo:501: 00000100:00100000:1.0:1788581145.482543:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058240:0@lo:503: 00000100:00100000:1.0:1788581145.482584:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.482611:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.482653:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058240 00000100:00100000:2.0:1788581145.482657:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058240 00000100:00100000:2.0:1788581145.482674:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581145.482679:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fe99b06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184058240:12345-0@lo:503: 00000040:00080000:2.0:1788581145.482713:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581145.482755:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fe99b06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184058240:12345-0@lo:503: Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.482761:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581145.482895:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058240:0@lo:503: 00000040:00080000:3.0:1788581145.483991:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788581145.484212:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788581145.484230:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581145.484405:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.484415:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581145.484464:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581145.484467:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e4eb3a800 10000000:01000000:1.0:1788581145.484469:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e4eb3a800 10000000:01000000:1.0:1788581145.484472:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581145.484477:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3a800 from 1 10000000:01000000:1.0:1788581145.484479:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581145.484506:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.484512:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.484521:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.484537:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058368:0@lo:101: 00000100:00100000:1.0:1788581145.484591:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.484631:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f34f2ed going to sleep for 11 seconds 00000100:00100000:3.0:1788581145.484692:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058368 00000100:00100000:3.0:1788581145.484698:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058368 00000100:00100000:3.0:1788581145.484735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581145.484742:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058705b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6470:x1875463184058368:12345-0@lo:101: 00010000:00010000:3.0:1788581145.484753:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581145.484762:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f726 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.484780:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.484787:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.484802:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000972103a1, rc 0) 00000100:00100000:3.0:1788581145.484848:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058705b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184058368:12345-0@lo:101: Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581145.484856:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581145.484989:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058368:0@lo:101: 00010000:00010000:1.0:1788581145.485001:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.485008:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.485053:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058496:0@lo:501: 00000100:00100000:1.0:1788581145.485076:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.485098:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f34f2ed going to sleep for 11 seconds 00000100:00100000:3.0:1788581145.485143:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058496 00000100:00100000:3.0:1788581145.485148:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058496 00000100:00100000:3.0:1788581145.485177:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581145.485183:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a454968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184058496:12345-0@lo:501: 00000100:00100000:3.0:1788581145.485304:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a454968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184058496:12345-0@lo:501: Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581145.485311:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581145.485373:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058496:0@lo:501: 00000100:00100000:1.0:1788581145.485408:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058624:0@lo:503: 00000100:00100000:1.0:1788581145.485444:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.485472:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f34f2ed going to sleep for 11 seconds 00000100:00100000:3.0:1788581145.485517:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058624 00000100:00100000:3.0:1788581145.485520:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058624 00000100:00100000:3.0:1788581145.485546:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581145.485552:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007afe5322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184058624:12345-0@lo:503: 00000100:00100000:3.0:1788581145.485622:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007afe5322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184058624:12345-0@lo:503: Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581145.485628:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581145.485701:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184058624:0@lo:503: 00000100:00100000:3.0:1788581145.485999:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6520:1875463184058752:0@lo:502: 00000100:00100000:3.0:1788581145.486034:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.486057:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026e1d86d going to sleep for 11 seconds 00000100:00100000:1.0:1788581145.486100:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058752 00000100:00100000:1.0:1788581145.486104:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058752 00000100:00100000:1.0:1788581145.486131:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581145.486138:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e2354a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6520:x1875463184058752:12345-0@lo:502: 00000100:00100000:1.0:1788581145.486203:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e2354a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6520:x1875463184058752:12345-0@lo:502: Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581145.486210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581145.486306:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6520:1875463184058752:0@lo:502: 00000020:01000004:3.0:1788581145.486360:0:6520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788581145.486375:0:6520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a4b1036d) 00000020:00000080:3.0:1788581145.486401:0:6520:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788581145.486488:0:6520:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c6b8884 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581145.486492:0:6520:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003c6b8884 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581145.486494:0:6520:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003c6b8884 4 00010000:00080000:3.0:1788581145.486519:0:6520:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000e910fa1@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581145.489172:0:6520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788581145.489472:0:6520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788581145.489508:0:6520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581145.489519:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x50f0cc74b7b2f73b 00000100:00080000:3.0:1788581145.489527:0:6520:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581145.489531:0:6520:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000e910fa1 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581145.489560:0:6520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004f7454a1 x1875463184058880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581145.489580:0:6520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788581145.489719:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6520:1875463184059008:0@lo:502: 00000100:00100000:3.0:1788581145.489780:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.489808:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcb99577 going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.489981:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184058880:0@lo:38: 00000100:00100000:2.0:1788581145.490014:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.490077:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184058880 00000100:00100000:3.0:1788581145.490082:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184058880 00000100:00100000:3.0:1788581145.490113:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581145.490118:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cedcdc11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184058880:12345-0@lo:38: 00000100:00100000:3.0:1788581145.490158:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cedcdc11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184058880:12345-0@lo:38: Request processed in 39us (144us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581145.490164:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581145.490235:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059008 00000100:00100000:1.0:1788581145.490239:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059008 00000100:00100000:1.0:1788581145.490292:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581145.490298:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0273b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6520:x1875463184059008:12345-0@lo:502: 00000100:00100000:1.0:1788581145.490409:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0273b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6520:x1875463184059008:12345-0@lo:502: Request processed in 112us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581145.490416:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581145.490531:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6520:1875463184059008:0@lo:502: 00000040:00080000:3.0:1788581145.490554:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788581145.490671:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581145.490677:0:3617:0:(import.c:65:import_set_state_nolock()) 000000000e910fa1 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581145.490680:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788581145.490683:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f7454a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184058880:0@lo:38: 00000020:01000000:1.0:1788581145.490747:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788581145.490765:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581145.490787:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.490797:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581145.490927:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581145.490929:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788581145.490930:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581145.490931:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581145.490932:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581145.490933:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581145.490934:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581145.490936:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788581145.490937:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581145.490938:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581145.490939:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581145.490941:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581145.490944:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788581145.490946:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581145.490947:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788581145.490948:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581145.490949:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581145.490950:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581145.490951:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581145.490951:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581145.490952:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788581145.490953:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581145.490954:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581145.490954:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581145.490960:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581145.490973:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788581145.490981:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184059136:0@lo:253: 00000100:00100000:1.0:1788581145.491012:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.491039:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042c6c2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1788581145.491079:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059136 00000100:00100000:3.0:1788581145.491083:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059136 00000100:00100000:3.0:1788581145.491110:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581145.491122:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055a535a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184059136:12345-0@lo:253: 20000000:01000000:3.0:1788581145.491139:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788581145.491150:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788581145.500410:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581145.500431:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788581145.500578:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581145.500583:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581145.500601:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.500619:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.500627:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.500662:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581145.500678:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581145.500692:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184059264:0@lo:104: 00000100:00100000:3.0:1788581145.500754:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581145.500804:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000826c474a going to sleep for 11 seconds 00000100:00100000:2.0:1788581145.500893:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059264 00000100:00100000:2.0:1788581145.500901:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059264 00000100:00100000:2.0:1788581145.500944:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581145.500952:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055e88f53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184059264:12345-0@lo:104: 00010000:00010000:2.0:1788581145.500964:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581145.501008:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581145.501014:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055e88f53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184059264:12345-0@lo:104: Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581145.501020:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581145.501073:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184059264:0@lo:104: 00010000:00010000:3.0:1788581145.501089:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.501192:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055a535a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6470:x1875463184059136:12345-0@lo:253: Request processed in 10070us (10178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581145.501199:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581145.501308:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000141a2383 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6470:1875463184059136:0@lo:253: 10000000:01000000:2.0:1788581145.501317:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788581145.501319:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581145.501321:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581145.501322:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581145.501323:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581145.501333:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581145.501334:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581145.501335:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581145.501337:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581145.501338:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581145.501339:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581145.501340:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581145.501342:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788581145.501352:0:6470:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788581145.503909:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581145.503922:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.503936:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6b02204 already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581145.503940:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.503950:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581145.503956:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581145.503961:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581145.504930:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.504941:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581145.504968:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.504992:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000f6b02204/0x50f0cc74b7b2f70a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f711 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505008:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581145.505010:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581145.505012:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581145.505396:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e6e9dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184059392:0@lo:103: 00000100:00100000:0.0:1788581145.505475:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581145.505574:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059392 00000100:00100000:1.0:1788581145.505582:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059392 00010000:00010000:1.0:1788581145.505607:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581145.505642:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581145.505650:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011888aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:3619:x1875463184059392:12345-0@lo:103: 00010000:00010000:1.0:1788581145.505661:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581145.505666:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505675:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505686:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059b081c7/0x50f0cc74b7b2f711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f70a expref: 12 pid: 6488 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505699:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505706:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581145.505728:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005145185s 00010000:00010000:1.0:1788581145.505731:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505737:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505742:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505748:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505753:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fcb4383b already unused, calling callback (00000000b3b830f6) 00010000:00010000:1.0:1788581145.505756:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505762:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505775:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505783:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581145.505820:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011888aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:3619:x1875463184059392:12345-0@lo:103: Request processed in 161us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581145.505827:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788581145.505849:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505865:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581145.505870:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fcb4383b/0x50f0cc74b7b2f742 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581145.506316:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e6e9dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184059392:0@lo:103: 00080000:10000000:2.0:1788581145.508675:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.509520:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788581145.509747:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.509891:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788581145.510051:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788581145.510196:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788581145.511093:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788581145.511236:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788581145.511619:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788581145.511767:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788581145.512034:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788581145.512181:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788581145.514642:0:6470:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788581145.521672:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788581145.521983:0:6526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788581145.523226:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788581145.523339:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788581145.523759:0:6470:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788581145.523766:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1788581145.523958:0:6525:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788581145.523964:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788581145.524405:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581145.525397:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788581145.528183:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788581145.528249:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788581145.528534:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788581145.528768:0:6470:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788581145.529684:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788581145.529806:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788581145.529931:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788581145.530032:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788581145.530132:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788581145.530236:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788581145.530405:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788581145.530519:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788581145.530762:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788581145.530947:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788581145.531095:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788581145.531216:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788581145.531369:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:2.0:1788581145.531805:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1788581145.537515:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788581145.537699:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000040:00080000:2.0:1788581145.537911:0:6526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581145.537985:0:6526:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788581145.537990:0:6526:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788581145.538213:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788581145.538535:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788581145.538687:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788581145.539026:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788581145.539478:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788581145.539616:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788581145.539765:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788581145.539972:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788581145.540092:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788581145.540217:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788581145.540664:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788581145.541073:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788581145.541711:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788581145.542150:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788581145.542980:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788581145.543508:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788581145.544084:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788581145.544940:0:6470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788581145.553683:0:6470:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581145.553756:0:6470:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffabf1416f3988 00100000:10000000:3.0:1788581145.553764:0:6470:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788581145.555109:0:6470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581145.555137:0:6470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581145.555181:0:6470:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788581145.555219:0:6470:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788581145.564154:0:6470:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581145.564554:0:6470:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788581146.308567:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581147.331948:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581148.354423:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581149.377734:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581150.405073:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581150.538690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581150.538700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788581150.538704:0:8:0:(import.c:65:import_set_state_nolock()) 000000000e910fa1 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581150.538715:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000e910fa1 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581150.538744:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc092867 x1875463184059648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581150.538862:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184059520:0@lo:400: 00000100:00100000:2.0:1788581150.538929:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581150.538990:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc092867 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184059648:0@lo:38: 00000100:00100000:2.0:1788581150.539019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581150.539059:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059520 00000100:00100000:3.0:1788581150.539067:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059520 00000100:00100000:3.0:1788581150.539111:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581150.539121:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf169b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:3620:x1875463184059520:12345-0@lo:400: 00000100:00100000:3.0:1788581150.539186:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf169b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:3620:x1875463184059520:12345-0@lo:400: Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581150.539192:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581150.539586:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184059520:0@lo:400: 00000100:00100000:1.0:1788581150.560919:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059648 00000100:00100000:1.0:1788581150.560935:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059648 00000100:00100000:1.0:1788581150.564437:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581150.564448:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057f9ea06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184059648:12345-0@lo:38: 00010000:00080000:1.0:1788581150.564481:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:1.0:1788581150.564520:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x50f0cc74b7b2f749 00000004:00100000:1.0:1788581150.564565:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581150.564691:0:6495:0:(import.c:65:import_set_state_nolock()) 0000000020d9bbd1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581150.564780:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057f9ea06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875463184059648:12345-0@lo:38: Request processed in 331us (25759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581150.564787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581150.564900:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fc092867 x1875463184059648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581150.564917:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788581150.564924:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788581150.564928:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788581150.564930:0:3617:0:(import.c:65:import_set_state_nolock()) 000000000e910fa1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581150.564936:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc092867 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184059648:0@lo:38: 00000001:02000400:0.0:1788581150.643319:0:6771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788581151.043088:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581151.043097:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3a800 from 3 10000000:01000000:3.0:1788581151.043101:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581151.043149:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581151.043160:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581151.043180:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581151.043203:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184059776:0@lo:101: 00000100:00100000:3.0:1788581151.043297:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581151.043358:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e7e27c1 going to sleep for 11 seconds 00000100:00100000:1.0:1788581151.044050:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059776 00000100:00100000:1.0:1788581151.044057:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059776 00000100:00100000:1.0:1788581151.044116:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581151.044125:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e09eb444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:6490:x1875463184059776:12345-0@lo:101: 00010000:00010000:1.0:1788581151.044137:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581151.044149:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f750 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581151.044190:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581151.044198:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581151.044207:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d8b13ef, rc 0) 00000100:00100000:1.0:1788581151.044462:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e09eb444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6490:x1875463184059776:12345-0@lo:101: Request processed in 338us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581151.044470:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581151.044511:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cdf00ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184059776:0@lo:101: 00010000:00010000:2.0:1788581151.044536:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581151.044557:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581151.044611:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003805db0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184059904:0@lo:256: 00000100:00100000:2.0:1788581151.044646:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581151.044676:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000312d88b9 going to sleep for 11 seconds 00000100:00100000:3.0:1788581151.044964:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184059904 00000100:00100000:3.0:1788581151.044969:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184059904 00000100:00100000:3.0:1788581151.045124:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788581151.045134:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab918e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6490:x1875463184059904:12345-0@lo:256: 20000000:01000000:3.0:1788581151.045155:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581151.045240:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581151.045244:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788581151.045458:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab918e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:6490:x1875463184059904:12345-0@lo:256: Request processed in 326us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581151.045466:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581151.045549:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003805db0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184059904:0@lo:256: 10000000:01000000:0.0:1788581151.045590:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581151.045596:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581151.045603:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581151.427636:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581151.740053:0:6823:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581151.740293:0:6823:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788581152.450941:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581153.473480:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581154.426516:0:6925:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581154.426739:0:6925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581154.500020:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581155.524488:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581155.653117:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcebd60b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184060032:0@lo:400: 00000100:00100000:3.0:1788581155.653192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581155.653272:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581155.653280:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184060160:0@lo:400: 00000100:00100000:3.0:1788581155.653312:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581155.654093:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060032 00000100:00100000:1.0:1788581155.654102:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060032 00000100:00100000:1.0:1788581155.654153:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581155.654161:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032728399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:3621:x1875463184060032:12345-0@lo:400: 00000100:00100000:1.0:1788581155.654221:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032728399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:3621:x1875463184060032:12345-0@lo:400: Request processed in 62us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581155.654228:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581155.656325:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060160 00000100:00100000:3.0:1788581155.656338:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060160 00000100:00100000:3.0:1788581155.656384:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581155.656405:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000672abb31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184060160:12345-0@lo:400: 00000100:00100000:3.0:1788581155.656482:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000672abb31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184060160:12345-0@lo:400: Request processed in 91us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581155.656489:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788581155.656529:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000073ec8c53 x1875463184060160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581155.656542:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184060160:0@lo:400: 00000100:00100000:0.0:1788581155.656899:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcebd60b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184060032:0@lo:400: 00010000:00010000:2.0:1788581156.547619:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581157.574718:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581158.595394:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581159.619079:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581160.643211:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581160.771042:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184060416:0@lo:400: 00000100:00100000:2.0:1788581160.771116:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581160.771151:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078cedf36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184060288:0@lo:400: 00000100:00100000:0.0:1788581160.771194:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581160.771297:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060288 00000100:00100000:2.0:1788581160.771305:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060288 00000100:00100000:1.0:1788581160.771313:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060416 00000100:00100000:1.0:1788581160.771320:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060416 00000100:00100000:2.0:1788581160.771351:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581160.771361:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b210c94b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:3619:x1875463184060288:12345-0@lo:400: 00000100:00100000:1.0:1788581160.771373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581160.771382:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047e2525f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184060416:12345-0@lo:400: 00000100:00100000:1.0:1788581160.771437:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047e2525f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184060416:12345-0@lo:400: Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581160.771465:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581160.771512:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000020d90748 x1875463184060416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581160.771524:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184060416:0@lo:400: 00000100:00100000:2.0:1788581160.787719:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b210c94b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:3619:x1875463184060288:12345-0@lo:400: Request processed in 16353us (16518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581160.787735:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581160.788713:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078cedf36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184060288:0@lo:400: 00010000:00010000:0.0:1788581161.665534:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581162.698121:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581163.713651:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788581163.833155:0:7423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788581163.833161:0:7423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788581163.833163:0:7423:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788581163.833371:0:7423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000d5000d8 00000020:01000004:3.0:1788581163.833391:0:7423:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788581163.833410:0:7423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788581163.833437:0:7423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d2759675) 00000020:00000080:3.0:1788581163.833465:0:7423:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788581163.900821:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788581163.900912:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788581163.926878:0:7423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788581163.927158:0:7423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788581163.927174:0:7423:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788581163.927188:0:7423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2f765 00000020:01000004:1.0:1788581163.927197:0:7423:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788581163.927223:0:7423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788581163.927226:0:7423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788581163.927233:0:7423:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788581163.927352:0:7423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788581163.927357:0:7423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788581163.940669:0:7423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788581163.940799:0:7423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788581163.940804:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788581163.940810:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788581163.940812:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581163.940813:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581163.940814:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581163.940815:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581163.940816:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581163.940818:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581163.940819:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581163.940821:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581163.940822:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581163.940826:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788581163.940829:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581163.940830:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788581163.940831:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581163.940832:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581163.940833:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581163.940834:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581163.940835:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581163.940835:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581163.940836:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581163.940837:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581163.940838:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581163.940873:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788581163.940895:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184060544:0@lo:253: 00000100:00100000:2.0:1788581163.940983:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581163.941103:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a4979e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.941189:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060544 00000100:00100000:3.0:1788581163.941199:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060544 00000100:00100000:3.0:1788581163.941410:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581163.941422:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c7062e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184060544:12345-0@lo:253: 20000000:01000000:3.0:1788581163.941473:0:6487:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788581163.941479:0:6487:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788581163.941486:0:6487:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788581163.941489:0:6487:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788581163.941535:0:6487:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788581163.941815:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581163.941969:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788581163.941983:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581163.942000:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788581163.942017:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788581163.942030:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788581163.942086:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788581163.942093:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788581163.942104:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788581163.942109:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788581163.942120:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788581163.942124:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788581163.942135:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788581163.942148:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788581163.942286:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788581163.942299:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581163.942314:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788581163.942327:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581163.942342:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788581163.942348:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581163.942361:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788581163.942367:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788581163.942380:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788581163.942394:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788581163.942404:0:6487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788581163.942482:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788581163.942490:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788581163.942503:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788581163.942519:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788581163.942535:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788581163.942541:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788581163.942554:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788581163.942575:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788581163.942581:0:6487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788581163.942601:0:6487:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788581163.942610:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788581163.943176:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788581163.943555:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788581163.943579:0:6487:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:3.0:1788581163.943582:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581163.943599:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788581163.943605:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788581163.943619:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788581163.943624:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581163.943642:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788581163.943650:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788581163.943664:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788581163.943678:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788581163.943803:0:6487:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788581163.943813:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788581163.944151:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788581163.944443:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788581163.944461:0:6487:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:3.0:1788581163.944463:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581163.944475:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788581163.944480:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581163.944491:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788581163.944495:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581163.944507:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788581163.944514:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788581163.944525:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788581163.944540:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788581163.944559:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788581163.944562:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788581163.944566:0:6487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788581163.944616:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788581163.944619:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581163.944953:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581163.944972:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581163.944986:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788581163.945131:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788581163.945149:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788581163.945164:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788581163.945172:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788581163.945174:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581163.945573:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581163.945593:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581163.945606:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788581163.945805:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788581163.945824:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788581163.945840:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788581163.945849:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788581163.945851:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581163.946070:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581163.946087:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581163.946100:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788581163.946234:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788581163.946558:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788581163.946593:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788581163.946618:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788581163.946621:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788581163.946627:0:6487:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788581163.946634:0:6487:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788581163.946986:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788581163.947102:0:6487:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788581163.955558:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788581163.955612:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955636:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955643:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955649:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955655:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955852:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.955870:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.955887:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d883dbe4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060672:0@lo:104: 00000100:00100000:2.0:1788581163.955970:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581163.956070:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.956078:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 12 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.956086:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099326731 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060800:0@lo:104: 00000100:00100000:2.0:1788581163.956106:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581163.956194:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.956202:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 12 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.956209:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206f8979 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060928:0@lo:104: 00000100:00100000:2.0:1788581163.956229:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581163.956660:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060672 00000100:00100000:1.0:1788581163.956671:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060672 00000100:00100000:1.0:1788581163.956727:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060800 00000100:00100000:1.0:1788581163.956730:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060800 00000100:00100000:1.0:1788581163.956754:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581163.956762:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048a43eab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184060672:12345-0@lo:104: 00010000:00010000:1.0:1788581163.956776:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.956838:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581163.956844:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048a43eab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184060672:12345-0@lo:104: Request processed in 83us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.956852:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581163.956872:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581163.956879:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b8a03b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184060800:12345-0@lo:104: 00010000:00010000:1.0:1788581163.956885:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.956918:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581163.956922:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b8a03b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184060800:12345-0@lo:104: Request processed in 45us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.956928:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788581163.956945:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581163.956951:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.956959:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c06c0cb already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581163.956963:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.956971:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581163.956989:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581163.956996:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581163.957027:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957034:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581163.957053:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957060:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f72d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957071:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581163.957073:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957079:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea2e83ec already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581163.957081:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957087:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581163.957092:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581163.957098:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581163.957114:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957121:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581163.957134:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957141:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000ea2e83ec/0x50f0cc74b7b2f6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6bd expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957150:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581163.957151:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581163.957153:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581163.957161:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581163.957175:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b78d3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184061056:0@lo:103: 00000100:00100000:1.0:1788581163.957206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581163.957243:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d2a2905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184061184:0@lo:103: 00000100:00100000:1.0:1788581163.957306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581163.957338:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061056 00000100:00100000:1.0:1788581163.957342:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061056 00010000:00010000:1.0:1788581163.957360:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 13 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581163.957381:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061184 00000100:00100000:1.0:1788581163.957384:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061184 00010000:00010000:1.0:1788581163.957393:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 14 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581163.957404:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581163.957409:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6040d64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3620:x1875463184061056:12345-0@lo:103: 00010000:00010000:1.0:1788581163.957430:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581163.957435:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 14 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957445:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 14 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957462:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581163.957488:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6040d64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3620:x1875463184061056:12345-0@lo:103: Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.957495:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581163.957508:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581163.957513:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ace162da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3618:x1875463184061184:12345-0@lo:103: 00010000:00010000:1.0:1788581163.957521:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581163.957524:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 13 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957532:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 13 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.957541:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581163.957564:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ace162da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3618:x1875463184061184:12345-0@lo:103: Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.957570:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581163.957620:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d2a2905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184061184:0@lo:103: 00000100:00100000:1.0:1788581163.957919:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b78d3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184061056:0@lo:103: 00010000:00010000:0.0:1788581163.957999:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581163.963611:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184060928 00000100:00100000:1.0:1788581163.963629:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184060928 00000100:00100000:1.0:1788581163.963720:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581163.963954:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e07473 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184060928:12345-0@lo:104: 00010000:00010000:1.0:1788581163.963976:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964084:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581163.964090:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e07473 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184060928:12345-0@lo:104: Request processed in 141us (7861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.964097:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788581163.964124:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581163.964129:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964137:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000338dda09 already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581163.964140:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964148:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581163.964155:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581163.964161:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581163.964201:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964208:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581163.964229:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964246:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000338dda09/0x50f0cc74b7b2f69a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f6a1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.964303:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581163.964305:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581163.964307:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581163.964315:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581163.964334:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b78d3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184061312:0@lo:103: 00000100:00100000:1.0:1788581163.964378:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581163.965015:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000885430bc going to sleep for 11 seconds 00010000:00010000:2.0:1788581163.965140:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000972103a1/0x50f0cc74b7b2f72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f726 expref: 12 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.965155:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d883dbe4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060672:0@lo:104: 00010000:00010000:2.0:1788581163.965169:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ccaa6fc/0x50f0cc74b7b2f6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f6b6 expref: 11 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.965177:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099326731 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060800:0@lo:104: 00000100:00100000:2.0:1788581163.965184:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206f8979 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184060928:0@lo:104: 00010000:00010000:2.0:1788581163.965209:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581163.965320:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061312 00000100:00100000:0.0:1788581163.965329:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061312 00010000:00010000:0.0:1788581163.965358:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 11 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581163.965392:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581163.965400:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d2a2905 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:3618:x1875463184061312:12345-0@lo:103: 00010000:00010000:0.0:1788581163.965414:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581163.965420:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 11 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965430:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 11 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965445:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f6a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f69a expref: 11 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965460:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965481:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965496:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965503:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965510:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965515:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965520:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a34935bd already unused, calling callback (00000000b3b830f6) 00010000:00010000:0.0:1788581163.965524:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.965531:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.965959:0:6487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.965979:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581163.965992:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:0.0:1788581163.966328:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.966338:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f76c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581163.966358:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581163.966445:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d2a2905 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:3618:x1875463184061312:12345-0@lo:103: Request processed in 1045us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581163.966462:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581163.966561:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b78d3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184061312:0@lo:103: 00000100:00100000:3.0:1788581163.971955:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c7062e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:7423:x1875463184060544:12345-0@lo:253: Request processed in 30525us (30961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.971975:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581163.972187:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184060544:0@lo:253: 10000000:01000000:2.0:1788581163.972206:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788581163.972210:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581163.972211:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788581163.972213:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581163.972214:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788581163.972215:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581163.972234:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581163.972235:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581163.972237:0:7423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788581163.972239:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581163.972240:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581163.972379:0:7423:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000d5000d8 from lustre-MDT0001 10000000:01000000:2.0:1788581163.972416:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788581163.972420:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788581163.972427:0:7423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7557cd28 local copy 10000000:01000000:2.0:1788581163.972432:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581163.972476:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.972487:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.972497:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581163.972517:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061440:0@lo:101: 00000100:00100000:2.0:1788581163.972683:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581163.972888:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000abe76543 going to sleep for 11 seconds 00000100:00100000:1.0:1788581163.972944:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061440 00000100:00100000:1.0:1788581163.972953:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061440 00000100:00100000:1.0:1788581163.973039:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581163.973048:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039733e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+9:7423:x1875463184061440:12345-0@lo:101: 00010000:00010000:1.0:1788581163.973077:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581163.973092:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c06c0cb/0x50f0cc74b7b2f77a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f773 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.973119:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c06c0cb/0x50f0cc74b7b2f77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f773 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.973129:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c06c0cb/0x50f0cc74b7b2f77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f773 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581163.973138:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c06c0cb, rc 0) 00000100:00100000:1.0:1788581163.973183:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039733e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:7423:x1875463184061440:12345-0@lo:101: Request processed in 136us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.973189:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581163.973291:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061440:0@lo:101: 00010000:00010000:3.0:1788581163.973305:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.973314:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581163.973427:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061568:0@lo:501: 00000100:00100000:3.0:1788581163.973455:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.974157:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aefe8fbd going to sleep for 11 seconds 00000100:00100000:2.0:1788581163.974244:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061568 00000100:00100000:2.0:1788581163.974251:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061568 00000100:00100000:2.0:1788581163.974309:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581163.974316:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063e57ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:7423:x1875463184061568:12345-0@lo:501: 00000100:00100000:2.0:1788581163.974408:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063e57ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:7423:x1875463184061568:12345-0@lo:501: Request processed in 93us (953us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581163.974415:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581163.974517:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061568:0@lo:501: 10000000:01000000:3.0:1788581163.974536:0:7423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788581163.974568:0:7423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788581163.974580:0:7423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.974590:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.974597:0:7423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.974648:0:7423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788581163.974677:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e4f1e6000 10000000:01000000:3.0:1788581163.974953:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788581163.974961:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff995e7557cd28 10000000:01000000:3.0:1788581163.974964:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788581163.974968:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff995e7557cd28 from 1 10000000:01000000:3.0:1788581163.974970:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788581163.974998:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975005:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975014:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581163.975030:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061696:0@lo:101: 00000100:00100000:3.0:1788581163.975078:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.975105:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061696 00000100:00100000:3.0:1788581163.975110:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061696 00000100:00100000:3.0:1788581163.975131:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581163.975137:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e2bafd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+10:7423:x1875463184061696:12345-0@lo:101: 00010000:00010000:3.0:1788581163.975146:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581163.975156:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a4b0b88/0x50f0cc74b7b2f788 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f781 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975173:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a4b0b88/0x50f0cc74b7b2f788 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f781 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975194:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a4b0b88/0x50f0cc74b7b2f788 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f781 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975203:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a4b0b88, rc 0) 00000100:00100000:3.0:1788581163.975226:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e2bafd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:7423:x1875463184061696:12345-0@lo:101: Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.975232:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581163.975306:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7bf1f2c going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.975320:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061696:0@lo:101: 00010000:00010000:3.0:1788581163.975332:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975340:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581163.975356:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788581163.975369:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975377:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000036f87fdc/0x50f0cc74b7b2f781 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581163.975386:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e4f1e6000 10000000:01000000:3.0:1788581163.975389:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788581163.975393:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e4f1e6000 from 1 10000000:01000000:3.0:1788581163.975395:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788581163.975406:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975418:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975426:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581163.975437:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061824:0@lo:101: 00000100:00100000:3.0:1788581163.975461:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.975478:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061824 00000100:00100000:3.0:1788581163.975482:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061824 00000100:00100000:3.0:1788581163.975497:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788581163.975502:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d39870d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+11:7423:x1875463184061824:12345-0@lo:101: 00010000:00010000:3.0:1788581163.975508:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581163.975516:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea2e83ec/0x50f0cc74b7b2f796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f78f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975527:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea2e83ec/0x50f0cc74b7b2f796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f78f expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975536:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea2e83ec/0x50f0cc74b7b2f796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f78f expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975542:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea2e83ec, rc 0) 00000100:00100000:3.0:1788581163.975563:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d39870d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184061824:12345-0@lo:101: Request processed in 61us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.975569:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788581163.975602:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7bf1f2c going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.975612:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061824:0@lo:101: 00010000:00010000:3.0:1788581163.975629:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975636:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581163.975646:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788581163.975648:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975654:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000972103a1/0x50f0cc74b7b2f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581163.975660:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788581163.975663:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581163.975667:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e4f1e6000 10000000:01000000:3.0:1788581163.975669:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788581163.975672:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788581163.975674:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788581163.975684:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975690:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.975708:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581163.975718:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061952:0@lo:101: 00000100:00100000:3.0:1788581163.976027:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.976143:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184061952 00000100:00100000:3.0:1788581163.976149:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184061952 00000100:00100000:3.0:1788581163.976168:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581163.976173:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099aa26b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184061952:12345-0@lo:101: 00010000:00010000:3.0:1788581163.976180:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581163.976188:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8bddd63/0x50f0cc74b7b2f7a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f79d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.976200:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8bddd63/0x50f0cc74b7b2f7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.976208:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8bddd63/0x50f0cc74b7b2f7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.976214:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8bddd63, rc 0) 00000100:00100000:3.0:1788581163.976236:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099aa26b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184061952:12345-0@lo:101: Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.976242:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581163.976296:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000712df681 going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.976310:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184061952:0@lo:101: 00010000:00010000:3.0:1788581163.976319:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.976325:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581163.976411:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062080:0@lo:501: 00000100:00100000:3.0:1788581163.976433:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.976451:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062080 00000100:00100000:3.0:1788581163.976460:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062080 00000100:00100000:3.0:1788581163.976476:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581163.976480:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007361216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062080:12345-0@lo:501: 00000100:00100000:3.0:1788581163.976822:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007361216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062080:12345-0@lo:501: Request processed in 340us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.976830:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581163.976859:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000712df681 going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.976871:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062080:0@lo:501: 00000100:00100000:3.0:1788581163.976896:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062208:0@lo:503: 00000100:00100000:3.0:1788581163.976937:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.976957:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062208 00000100:00100000:3.0:1788581163.976961:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062208 00000100:00100000:3.0:1788581163.976977:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581163.976982:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f27e9227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062208:12345-0@lo:503: 00000100:00100000:3.0:1788581163.977051:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f27e9227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062208:12345-0@lo:503: Request processed in 69us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581163.977174:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581163.977181:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.977202:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a34935bd already unused, calling callback (000000002a7d193f) 10000000:00010000:2.0:1788581163.977205:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.977213:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581163.977221:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581163.977226:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581163.977249:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.977290:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581163.977320:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.977327:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f77a expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581163.977344:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581163.977345:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581163.977347:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581163.977393:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581163.977434:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000712df681 going to sleep for 11 seconds 00000100:00100000:3.0:1788581163.977445:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062208:0@lo:503: 00000040:00080000:3.0:1788581163.977965:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581163.978038:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062464:0@lo:502: 00000100:00100000:3.0:1788581163.978084:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.978204:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000712df681 going to sleep for 11 seconds 00000100:00100000:1.0:1788581163.978422:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062464 00000100:00100000:1.0:1788581163.978437:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062464 00000100:00100000:1.0:1788581163.978452:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206f8979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184062336:0@lo:103: 00000100:00100000:1.0:1788581163.978487:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581163.978566:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788581163.978580:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b17aca1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062464:12345-0@lo:502: 00000100:00100000:1.0:1788581163.978679:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b17aca1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062464:12345-0@lo:502: Request processed in 107us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581163.978687:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581163.978912:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062336 00000100:00100000:3.0:1788581163.978917:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062336 00000100:00100000:3.0:1788581163.978948:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581163.978954:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000976e2422 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3620:x1875463184062336:12345-0@lo:103: 00010000:00010000:3.0:1788581163.978970:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581163.978990:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c06c0cb/0x50f0cc74b7b2f77a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2f773 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581163.979008:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581163.979039:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000976e2422 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3620:x1875463184062336:12345-0@lo:103: Request processed in 86us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581163.979045:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581163.979082:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062464:0@lo:502: 00000040:00080000:3.0:1788581163.979342:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:1.0:1788581163.979365:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206f8979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184062336:0@lo:103: 00000040:00080000:3.0:1788581163.979372:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788581163.979385:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788581163.979399:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788581163.979412:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788581163.979424:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788581163.979435:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788581163.979447:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788581163.979459:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788581163.979471:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788581163.979484:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788581163.979495:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788581163.979506:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788581163.979520:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788581163.979549:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788581163.979565:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788581163.979592:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788581163.979606:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788581163.979619:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788581163.979630:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788581163.979643:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788581163.979663:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788581163.979675:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788581163.979714:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062592:0@lo:502: 00000100:00100000:3.0:1788581163.979880:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581163.979918:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000712df681 going to sleep for 11 seconds 00000100:00100000:0.0:1788581163.980028:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062592 00000100:00100000:0.0:1788581163.980034:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062592 00000100:00100000:0.0:1788581163.980097:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581163.980104:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c120abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184062592:12345-0@lo:502: 00000100:00100000:0.0:1788581163.980213:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c120abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184062592:12345-0@lo:502: Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581163.980221:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581163.980338:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062592:0@lo:502: 00000040:00080000:3.0:1788581163.980382:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788581163.980391:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788581163.980977:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581163.980990:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581163.980993:0:7435:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788581163.980998:0:7435:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788581163.981001:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581163.981017:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a8e24942) 00000020:00000080:3.0:1788581163.981038:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788581163.981043:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581163.981140:0:7435:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581163.981148:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2f7b2 00000020:00000080:3.0:1788581163.981400:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788581163.981404:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581163.981408:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581163.981410:0:7435:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788581163.981412:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581163.981416:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581163.981417:0:7435:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788581163.981420:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581163.981428:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000052df4c8e) 00000020:00000080:3.0:1788581163.981438:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788581163.981442:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788581163.981444:0:7435:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788581163.981447:0:7435:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788581163.981459:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581163.981513:0:7435:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000d5000d8 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788581163.981527:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000089cb0bb4) 00000020:00000080:3.0:1788581163.981535:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788581163.981667:0:7435:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788581163.981674:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2f7c7 00000020:00000080:3.0:1788581163.981901:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788581163.981908:0:7435:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788581163.981913:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x50f0cc74b7b2f7ce 00080000:01000000:3.0:1788581163.981919:0:7435:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788581163.981922:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2f7d5 00080000:10000000:3.0:1788581163.982380:0:7435:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788581163.982500:0:7435:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788581164.093102:0:7435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788581164.093496:0:7435:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788581164.098513:0:7435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788581164.098856:0:7435:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788581164.137173:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788581164.137190:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581164.137201:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581164.137204:0:7435:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788581164.137210:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581164.137217:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581164.137219:0:7435:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788581164.137222:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788581164.137228:0:7435:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:3.0:1788581164.137304:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581164.137340:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000000589f256) 00000020:00000080:3.0:1788581164.137371:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788581164.137378:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788581164.137500:0:7435:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788581164.137507:0:7435:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788581164.137515:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2f7e3 00010000:00080000:3.0:1788581164.137554:0:7435:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008556f499@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581164.150054:0:7435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788581164.152383:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581164.152403:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788581164.152463:0:7435:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788581164.152489:0:7435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2f7ea 00000100:00080000:0.0:1788581164.152501:0:7435:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581164.152507:0:7435:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008556f499 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581164.152555:0:7435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c71b9119 x1875463184062720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581164.152596:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c71b9119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184062720:0@lo:38: 00000100:00100000:0.0:1788581164.152991:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581164.153163:0:7435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788581164.153229:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581164.153233:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153235:0:7435:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788581164.153238:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788581164.153241:0:7435:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788581164.153243:0:7435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581164.153245:0:7435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581164.153246:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788581164.153249:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153296:0:7435:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788581164.153301:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581164.153307:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153308:0:7435:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788581164.153312:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788581164.153359:0:7435:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788581164.153372:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581164.153375:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153376:0:7435:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788581164.153379:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581164.153381:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153382:0:7435:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788581164.153385:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788581164.153386:0:7435:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788581164.153434:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581164.153437:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581164.153439:0:7435:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788581164.153442:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788581164.153571:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788581164.153601:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788581164.153617:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.153630:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000fcb4383b/0x50f0cc74b7b2f79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581164.153651:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4f1e6000 from 1 10000000:01000000:0.0:1788581164.153654:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581164.153684:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.153702:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581164.154930:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184062976:0@lo:400: 00000100:00100000:3.0:1788581164.155010:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.155077:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062976 00000100:00100000:3.0:1788581164.155086:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062976 00000100:00100000:3.0:1788581164.155139:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581164.155149:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fe795e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184062976:12345-0@lo:400: 00000100:00100000:3.0:1788581164.155210:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fe795e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184062976:12345-0@lo:400: Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.155217:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581164.155287:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000073ec8c53 x1875463184062976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581164.155303:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184062976:0@lo:400: 00010000:00010000:0.0:1788581164.155388:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.155415:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062848:0@lo:101: 00000100:00100000:0.0:1788581164.155454:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.155481:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad82cdd going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.156895:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062848 00000100:00100000:3.0:1788581164.156910:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062848 00000100:00100000:3.0:1788581164.156972:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581164.156982:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e3c3d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+12:7423:x1875463184062848:12345-0@lo:101: 00010000:00010000:3.0:1788581164.157001:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581164.157021:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f7f1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.157053:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.157065:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.157075:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da83a2fd, rc 0) 00000100:00100000:3.0:1788581164.157150:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e3c3d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184062848:12345-0@lo:101: Request processed in 170us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.157158:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581164.157550:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184062848:0@lo:101: 00010000:00010000:0.0:1788581164.157572:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.157582:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.159160:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063104:0@lo:256: 00000100:00100000:0.0:1788581164.159250:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.159344:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad82cdd going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.159552:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063104 00000100:00100000:2.0:1788581164.159556:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184062720 00000100:00100000:3.0:1788581164.159564:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063104 00000100:00100000:2.0:1788581164.159564:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184062720 00000100:00100000:2.0:1788581164.159624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581164.159625:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581164.159637:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c82db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184063104:12345-0@lo:256: 20000000:01000000:3.0:1788581164.159663:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788581164.159686:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788581164.159690:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788581164.159804:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c82db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184063104:12345-0@lo:256: Request processed in 168us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.159812:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581164.159873:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063104:0@lo:256: 00000100:00100000:2.0:1788581164.160864:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd143f8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184062720:12345-0@lo:38: 00010000:00080000:1.0:1788581164.160953:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:1.0:1788581164.161013:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2f7ff 00000004:00100000:1.0:1788581164.161031:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788581164.161038:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:0.0:1788581164.161144:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581164.161174:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.161186:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581164.161196:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4f1e6000 from 1 10000000:01000000:0.0:1788581164.161199:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581164.161240:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.161249:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.161292:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.161312:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063232:0@lo:101: 00000100:00100000:0.0:1788581164.161365:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.161408:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad82cdd going to sleep for 11 seconds 00000100:00100000:1.0:1788581164.161527:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063232 00000100:00100000:1.0:1788581164.161535:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063232 00000100:00100000:1.0:1788581164.161580:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581164.161588:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c82ab2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:7423:x1875463184063232:12345-0@lo:101: 00010000:00010000:1.0:1788581164.161602:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581164.161615:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f806 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.161650:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.161661:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.161680:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008379cfc2, rc 0) 00000100:00100000:1.0:1788581164.161721:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c82ab2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063232:12345-0@lo:101: Request processed in 134us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.161728:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581164.162374:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063232:0@lo:101: 00010000:00010000:0.0:1788581164.162391:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.162402:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.162943:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063360:0@lo:501: 00000100:00100000:0.0:1788581164.162995:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.163043:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad82cdd going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.163354:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063360 00000100:00100000:3.0:1788581164.163362:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063360 00000100:00100000:3.0:1788581164.163406:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788581164.163414:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9fbc5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063360:12345-0@lo:501: 00000100:00100000:3.0:1788581164.163880:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9fbc5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063360:12345-0@lo:501: Request processed in 465us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.163889:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581164.165146:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063360:0@lo:501: 00000100:00100000:0.0:1788581164.165223:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063488:0@lo:503: 00000100:00100000:0.0:1788581164.165680:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.165782:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad82cdd going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.165828:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063488 00000100:00100000:3.0:1788581164.165837:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063488 00000100:00100000:3.0:1788581164.165924:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581164.165935:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c002be18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063488:12345-0@lo:503: 00000040:00080000:3.0:1788581164.165995:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581164.166065:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c002be18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063488:12345-0@lo:503: Request processed in 132us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.166073:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581164.166159:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063488:0@lo:503: 00000040:00080000:0.0:1788581164.166503:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581164.166571:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788581164.166669:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581164.167674:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788581164.167843:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788581164.167874:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581164.167897:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.167911:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581164.167975:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581164.167978:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e4f1e6000 10000000:01000000:1.0:1788581164.167982:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e4f1e6000 10000000:01000000:1.0:1788581164.167986:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581164.167993:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4f1e6000 from 1 10000000:01000000:1.0:1788581164.167995:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581164.168037:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.168044:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.168408:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581164.168440:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083d03109 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063616:0@lo:101: 00000100:00100000:1.0:1788581164.168534:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.168573:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000652ed591 going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.168622:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063616 00000100:00100000:3.0:1788581164.168641:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063616 00000100:00100000:3.0:1788581164.168826:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581164.168836:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd756c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:7423:x1875463184063616:12345-0@lo:101: 00010000:00010000:3.0:1788581164.168851:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581164.168866:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ecc00eb9/0x50f0cc74b7b2f81b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f814 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.168891:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecc00eb9/0x50f0cc74b7b2f81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.168901:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ecc00eb9/0x50f0cc74b7b2f81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581164.168911:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ecc00eb9, rc 0) 00000100:00100000:3.0:1788581164.168964:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd756c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184063616:12345-0@lo:101: Request processed in 130us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.168971:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581164.169146:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083d03109 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063616:0@lo:101: 00010000:00010000:1.0:1788581164.169163:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.169172:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581164.169340:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083d03109 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063744:0@lo:501: 00000100:00100000:1.0:1788581164.169368:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.169384:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000652ed591 going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.169816:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063744 00000100:00100000:3.0:1788581164.169822:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063744 00000100:00100000:3.0:1788581164.169858:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581164.169866:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041beee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184063744:12345-0@lo:501: 00000100:00100000:3.0:1788581164.169990:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041beee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184063744:12345-0@lo:501: Request processed in 126us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.169997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581164.170677:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083d03109 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063744:0@lo:501: 00000100:00100000:0.0:1788581164.170730:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063872:0@lo:503: 00000100:00100000:0.0:1788581164.170794:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.170830:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184063872 00000100:00100000:0.0:1788581164.170834:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cee9e827 going to sleep for 11 seconds 00000100:00100000:1.0:1788581164.170837:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184063872 00000100:00100000:1.0:1788581164.170883:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581164.170891:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a07bc1c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184063872:12345-0@lo:503: 00000100:00100000:1.0:1788581164.170999:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a07bc1c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184063872:12345-0@lo:503: Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.171007:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581164.172029:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184063872:0@lo:503: 00000040:00080000:0.0:1788581164.172433:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581164.172556:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064000:0@lo:502: 00000100:00100000:0.0:1788581164.172624:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.172673:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cee9e827 going to sleep for 11 seconds 00000100:00100000:1.0:1788581164.172840:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064000 00000100:00100000:1.0:1788581164.172848:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064000 00000100:00100000:1.0:1788581164.172896:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581164.172905:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000147557f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184064000:12345-0@lo:502: 00000100:00100000:1.0:1788581164.173026:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000147557f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184064000:12345-0@lo:502: Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.173033:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788581164.176858:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064000:0@lo:502: 00000100:00080000:1.0:1788581164.177032:0:6498:0:(import.c:65:import_set_state_nolock()) 00000000cfbb4427 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581164.177173:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd143f8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184062720:12345-0@lo:38: Request processed in 17537us (24182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.177185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581164.177318:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581164.177328:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788581164.177339:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000040:00080000:0.0:1788581164.177370:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788581164.177404:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788581164.177420:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788581164.177434:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788581164.177449:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000100:00080000:2.0:1788581164.177517:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581164.177521:0:3617:0:(import.c:65:import_set_state_nolock()) 000000008556f499 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581164.177568:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c71b9119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184062720:0@lo:38: 00000040:00080000:0.0:1788581164.177669:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788581164.177686:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788581164.177697:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788581164.177710:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788581164.177724:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788581164.177737:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000100:00100000:2.0:1788581164.177743:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184064128:0@lo:41: 00000040:00080000:0.0:1788581164.177749:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788581164.177760:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788581164.177772:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788581164.177786:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000100:00100000:2.0:1788581164.177792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788581164.177799:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788581164.177823:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788581164.177834:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788581164.177846:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788581164.177860:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000100:00100000:1.0:1788581164.177872:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064128 00000040:00080000:0.0:1788581164.177874:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000100:00100000:1.0:1788581164.177881:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064128 00000040:00080000:0.0:1788581164.177886:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788581164.177897:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788581164.177910:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788581164.177921:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000100:00100000:1.0:1788581164.177924:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581164.177933:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099326731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184064128:12345-0@lo:41: 00000040:00080000:0.0:1788581164.177933:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000004:00000024:1.0:1788581164.177964:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788581164.178135:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099326731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184064128:12345-0@lo:41: Request processed in 202us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.178142:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1788581164.178159:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788581164.178181:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788581164.178197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ec8c53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184064128:0@lo:41: 00000100:00100000:0.0:1788581164.178207:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064256:0@lo:502: 00000100:00100000:0.0:1788581164.178429:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.178474:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064256 00000100:00100000:1.0:1788581164.178479:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064256 00000100:00100000:1.0:1788581164.178508:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581164.178514:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d60d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184064256:12345-0@lo:502: 00000100:00100000:0.0:1788581164.178526:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cee9e827 going to sleep for 11 seconds 00000100:00100000:1.0:1788581164.178634:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d60d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184064256:12345-0@lo:502: Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.178641:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788581164.178832:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb88884 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064256:0@lo:502: 00000040:00080000:0.0:1788581164.178876:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788581164.178884:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788581164.179857:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788581164.179878:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000092b6b4bb) 00000020:00000080:3.0:1788581164.179903:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788581164.180009:0:7441:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000d5000d8 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788581164.180019:0:7441:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000d5000d8 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788581164.180022:0:7441:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000d5000d8 3 00010000:00080000:3.0:1788581164.180057:0:7441:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009b6a126d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581164.186372:0:7441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788581164.186963:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788581164.187115:0:7441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581164.187132:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x50f0cc74b7b2f829 00000100:00080000:3.0:1788581164.187145:0:7441:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581164.187150:0:7441:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009b6a126d using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581164.187192:0:7441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e6a6075b x1875463184064384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581164.187324:0:7441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788581164.187562:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6a6075b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184064384:0@lo:38: 00000100:00100000:2.0:1788581164.187663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.188070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064384 00000100:00100000:3.0:1788581164.188080:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064384 00000100:00100000:3.0:1788581164.188125:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581164.188133:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d883dbe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184064384:12345-0@lo:38: 00010000:00080000:3.0:1788581164.188160:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:3.0:1788581164.188197:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x50f0cc74b7b2f830 00000004:00100000:3.0:1788581164.188214:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581164.188249:0:6494:0:(import.c:65:import_set_state_nolock()) 000000009b99858d : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788581164.188688:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1788581164.188797:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d883dbe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875463184064384:12345-0@lo:38: Request processed in 663us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.188806:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581164.188849:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e6a6075b x1875463184064384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581164.188860:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581164.188870:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788581164.188887:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788581164.188891:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788581164.188893:0:3617:0:(import.c:65:import_set_state_nolock()) 000000009b6a126d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788581164.188899:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6a6075b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184064384:0@lo:38: 40000000:00080000:1.0:1788581164.189149:0:7442:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1788581164.190357:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788581164.190403:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581164.190424:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.190438:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000002c06c0cb/0x50f0cc74b7b2f814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581164.190604:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581164.190610:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581164.190611:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581164.190613:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581164.190614:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581164.190615:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581164.190616:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581164.190618:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581164.190619:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581164.190621:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581164.190622:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581164.190626:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788581164.190628:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581164.190630:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581164.190630:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581164.190631:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581164.190632:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581164.190633:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581164.190634:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581164.190635:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581164.190635:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581164.190636:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581164.190637:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581164.190667:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788581164.190685:0:7423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d04d0c86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064512:0@lo:253: 00000100:00100000:1.0:1788581164.190755:0:7423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.190880:0:7423:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db5bd035 going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.191094:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064512 00000100:00100000:3.0:1788581164.191104:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064512 00000100:00100000:3.0:1788581164.191170:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581164.191179:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1eb7277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7423:x1875463184064512:12345-0@lo:253: 20000000:01000000:3.0:1788581164.191211:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788581164.191227:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788581164.192865:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788581164.193109:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788581164.193162:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788581164.194756:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788581164.194768:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788581164.194796:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.194822:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.194830:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.194837:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.194891:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.194922:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 15 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581164.194940:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f80f61c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184064640:0@lo:104: 00000100:00100000:2.0:1788581164.195099:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581164.195163:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581164.195172:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 15 pid: 6486 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581164.195181:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184064768:0@lo:104: 00000100:00100000:2.0:1788581164.195202:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581164.195227:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032caaabd going to sleep for 11 seconds 00000100:00100000:0.0:1788581164.195304:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064640 00000100:00100000:0.0:1788581164.195315:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064640 00000100:00100000:1.0:1788581164.195334:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064768 00000100:00100000:1.0:1788581164.195340:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064768 00000100:00100000:1.0:1788581164.195374:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581164.195383:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078cedf36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184064768:12345-0@lo:104: 00010000:00010000:1.0:1788581164.195398:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195564:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581164.195570:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078cedf36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184064768:12345-0@lo:104: Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.195589:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581164.195613:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581164.195622:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206f8979 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184064640:12345-0@lo:104: 00010000:00010000:1.0:1788581164.195630:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195678:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581164.195682:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206f8979 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184064640:12345-0@lo:104: Request processed in 65us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.195688:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788581164.195708:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581164.195714:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195722:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065e57c63 already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581164.195725:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195734:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581164.195741:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581164.195747:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581164.195778:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.195779:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f80f61c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184064640:0@lo:104: 00010000:00010000:1.0:1788581164.195786:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788581164.195788:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184064768:0@lo:104: 00010000:00010000:0.0:1788581164.195807:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195811:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195817:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 0000000065e57c63/0x50f0cc74b7b2f750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f757 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195829:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788581164.195831:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002602e8b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184064896:0@lo:103: 00010000:00010000:1.0:1788581164.195832:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195838:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df875ba3 already unused, calling callback (000000002a7d193f) 10000000:00010000:1.0:1788581164.195840:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195845:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581164.195852:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581164.195857:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788581164.195864:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581164.195871:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195876:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581164.195904:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581164.195911:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000df875ba3/0x50f0cc74b7b2f7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7f8 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.195926:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184064896 00010000:00010000:1.0:1788581164.195933:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581164.195936:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581164.195937:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184064896 00010000:00010000:1.0:1788581164.195939:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581164.195942:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581164.195965:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 16 pid: 6486 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.196005:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581164.196012:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb88884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3619:x1875463184064896:12345-0@lo:103: 00010000:00010000:0.0:1788581164.196026:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581164.196031:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 16 pid: 6486 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581164.196068:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1eb7277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:7423:x1875463184064512:12345-0@lo:253: Request processed in 4872us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.196086:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581164.196097:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be7024f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184065024:0@lo:103: 00000100:00100000:1.0:1788581164.196145:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.196184:0:6480:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788581164.196196:0:6480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788581164.196224:0:7423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d04d0c86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7423:1875463184064512:0@lo:253: 10000000:01000000:1.0:1788581164.196241:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788581164.196245:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581164.196247:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581164.196248:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581164.196249:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581164.196432:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581164.196435:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581164.196436:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581164.196438:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581164.196439:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581164.196441:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581164.196442:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788581164.196455:0:7423:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788581164.196460:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 15 pid: 6486 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196473:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d8b13ef/0x50f0cc74b7b2f757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f750 expref: 15 pid: 6486 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196680:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581164.196818:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb88884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3619:x1875463184064896:12345-0@lo:103: Request processed in 808us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.196827:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581164.196841:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065024 00000100:00100000:0.0:1788581164.196845:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065024 00010000:00010000:0.0:1788581164.196860:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 14 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581164.196874:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581164.196879:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b46a4c91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3620:x1875463184065024:12345-0@lo:103: 00010000:00010000:0.0:1788581164.196886:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581164.196889:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 14 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196912:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 14 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196921:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f7f1 expref: 14 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196937:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196944:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788581164.196959:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005145185s 00010000:00010000:0.0:1788581164.196963:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196969:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196975:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196980:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196985:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a34935bd already unused, calling callback (00000000b3b830f6) 00010000:00010000:0.0:1788581164.196989:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.196996:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.197016:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.197026:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581164.197069:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b46a4c91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3620:x1875463184065024:12345-0@lo:103: Request processed in 190us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.197075:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581164.197136:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be7024f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184065024:0@lo:103: 00010000:00010000:0.0:1788581164.197154:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.197161:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581164.197166:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a34935bd/0x50f0cc74b7b2f837 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581164.197891:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002602e8b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184064896:0@lo:103: 00080000:10000000:1.0:1788581164.202599:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788581164.202891:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788581164.203220:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788581164.203537:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788581164.204381:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788581164.204613:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788581164.206756:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788581164.207130:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788581164.207419:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788581164.207725:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788581164.207923:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788581164.208110:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788581164.209999:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788581164.210237:0:7448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788581164.210344:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011888aa2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875463184065152:0@lo:700: 00000100:00100000:0.0:1788581164.210445:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.210486:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bedf60ca going to sleep for 11 seconds 00000040:01000000:2.0:1788581164.210630:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1788581164.210843:0:7447:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788581164.210848:0:7447:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788581164.211004:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d04d0c86 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065280:0@lo:1000: 00000100:00100000:1.0:1788581164.211054:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.211084:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388b8901 going to sleep for 11 seconds 00000040:01000000:2.0:1788581164.211539:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788581164.211653:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065152 00000100:00100000:3.0:1788581164.211663:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065152 00000040:00080000:2.0:1788581164.211680:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581164.211721:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581164.211731:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb88884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7448:x1875463184065152:12345-0@lo:700: 00000004:00000080:2.0:1788581164.212146:0:7423:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788581164.212155:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788581164.212310:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065280 00000100:00100000:0.0:1788581164.212316:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065280 00000040:00080000:2.0:1788581164.212341:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581164.212351:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581164.212359:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000187faee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065280:12345-0@lo:1000: 00000100:00100000:0.0:1788581164.212461:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000187faee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065280:12345-0@lo:1000: Request processed in 104us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.212469:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581164.212583:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d04d0c86 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065280:0@lo:1000: 00000040:01000000:3.0:1788581164.212619:0:7449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788581164.212652:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6a6075b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065408:0@lo:700: 00000100:00100000:3.0:1788581164.212691:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.212726:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db6dd31f going to sleep for 11 seconds 00000100:00100000:0.0:1788581164.212928:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065408 00000100:00100000:0.0:1788581164.212933:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065408 00000100:00100000:0.0:1788581164.212957:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581164.212963:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023e9f27d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065408:12345-0@lo:700: 00000100:00100000:0.0:1788581164.213026:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023e9f27d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065408:12345-0@lo:700: Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.213033:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581164.213141:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6a6075b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065408:0@lo:700: 00000040:00080000:2.0:1788581164.213321:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788581164.213327:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875463184065536:0@lo:900: 00000100:00100000:1.0:1788581164.213433:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.213593:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000587c7caa going to sleep for 11 seconds 00000100:00100000:3.0:1788581164.213621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065536 00000100:00100000:3.0:1788581164.213626:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065536 00000100:00100000:3.0:1788581164.213665:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581164.213672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7449:x1875463184065536:12345-0@lo:900: 00000100:00100000:3.0:1788581164.213813:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7449:x1875463184065536:12345-0@lo:900: Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.213821:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788581164.213835:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788581164.213861:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:1.0:1788581164.213934:0:7449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000012818bf8 x1875463184065536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581164.213947:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875463184065536:0@lo:900: 00000040:00080000:2.0:1788581164.214084:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581164.214184:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065664:0@lo:1000: 00000100:00100000:1.0:1788581164.214226:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1788581164.214432:0:7423:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788581164.215128:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788581164.215296:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788581164.215430:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788581164.215553:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788581164.215698:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788581164.215947:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788581164.216077:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788581164.216212:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788581164.216387:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788581164.216508:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788581164.216624:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788581164.216741:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788581164.216876:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788581164.217057:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788581164.217175:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:1.0:1788581164.217543:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff0a079f going to sleep for 11 seconds 00000100:00100000:0.0:1788581164.217921:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065664 00000100:00100000:0.0:1788581164.217932:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065664 00000100:00100000:0.0:1788581164.217999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581164.218010:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058a55388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065664:12345-0@lo:1000: 00000100:00100000:0.0:1788581164.218248:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058a55388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065664:12345-0@lo:1000: Request processed in 239us (4021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.218282:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:3.0:1788581164.218526:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:2.0:1788581164.218753:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065664:0@lo:1000: 00000004:00080000:2.0:1788581164.218830:0:7449:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000587c7caa with version 0 00000020:00100000:2.0:1788581164.218862:0:7449:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788581164.218869:0:7449:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000020d90748 x1875463184065920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581164.218900:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065920:0@lo:1000: 00000100:00100000:2.0:1788581164.218954:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:3.0:1788581164.218963:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:2.0:1788581164.219067:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095a013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581164.219224:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184065920 00000100:00100000:1.0:1788581164.219232:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184065920 00000100:00100000:1.0:1788581164.219390:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581164.219398:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003805db0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065920:12345-0@lo:1000: 00100000:10000000:3.0:1788581164.219638:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 40000000:02000000:2.0:1788581164.222837:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1788581164.223096:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788581164.223531:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788581164.223673:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788581164.223827:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788581164.224005:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788581164.224166:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788581164.224340:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788581164.224489:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788581164.224647:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788581164.224835:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788581164.228981:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788581164.229879:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788581164.230617:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788581164.230872:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788581164.231444:0:7423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788581164.232525:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1788581164.232532:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb88884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7448:x1875463184065152:12345-0@lo:700: Request processed in 20797us (22094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581164.232552:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788581164.232586:0:7448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000011888aa2 x1875463184065152/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581164.232607:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011888aa2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875463184065152:0@lo:700: 40000000:02000000:0.0:1788581164.232626:0:7448:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1788581164.234798:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003805db0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184065920:12345-0@lo:1000: Request processed in 15393us (15838us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788581164.234816:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788581164.235541:0:7449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788581164.235550:0:7449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788581164.235568:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184065920:0@lo:1000: 00000100:00100000:2.0:1788581164.235751:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184066048:0@lo:1000: 00000100:00100000:2.0:1788581164.235882:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581164.236109:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066048 00000100:00100000:1.0:1788581164.236117:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066048 00000100:00100000:1.0:1788581164.236169:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581164.236178:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4d60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184066048:12345-0@lo:1000: 00000100:00100000:2.0:1788581164.236300:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f87e9f76 going to sleep for 11 seconds 00000100:00100000:2.0:1788581164.237130:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875463184066048:0@lo:1000: 00000040:00080000:2.0:1788581164.237160:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581164.237305:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4d60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875463184066048:12345-0@lo:1000: Request processed in 852us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581164.237318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1788581164.237843:0:7449:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000095a013c0 with version 1 00000004:00080000:3.0:1788581164.238371:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a8117c58 version 1 rpc_version 1 00000020:00100000:3.0:1788581164.238410:0:7438:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788581164.238490:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002f75afcc x1875463184066304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581164.238517:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002f75afcc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1875463184066304:0@lo:1000: 00000100:00100000:3.0:1788581164.238618:0:7438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581164.238752:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066304 00000100:00100000:3.0:1788581164.238762:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e099949b going to sleep for 11 seconds 00000100:00100000:0.0:1788581164.238768:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066304 00000100:00100000:0.0:1788581164.238804:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581164.238809:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788581164.238813:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076e1ef19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7438:x1875463184066304:12345-0@lo:1000: 00000100:00100000:1.0:1788581164.238821:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000001:00080000:0.0:1788581164.240060:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788581164.240551:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076e1ef19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7438:x1875463184066304:12345-0@lo:1000: Request processed in 1735us (1929us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788581164.240570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788581164.241385:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788581164.241393:0:7438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788581164.241415:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002f75afcc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1875463184066304:0@lo:1000: 00000001:00080000:3.0:1788581164.241586:0:7423:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581164.241623:0:7423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffabf1419c3988 00100000:10000000:3.0:1788581164.241633:0:7423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788581164.242384:0:7423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788581164.242425:0:7423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788581164.242447:0:7423:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788581164.242470:0:7423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788581164.243524:0:7423:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581164.243819:0:7423:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788581164.244494:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581164.244590:0:7449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788581164.260667:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581164.276120:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788581164.276706:0:7448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788581164.276718:0:7448:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788581164.737600:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581165.761484:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581166.785373:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581167.809699:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581168.833585:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581168.960990:0:7695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788581169.474613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2c1b22c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184066560:0@lo:400: 00000100:00100000:1.0:1788581169.474751:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011888aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184066432:0@lo:400: 00000100:00100000:1.0:1788581169.474806:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581169.474860:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581169.474867:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1284369 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184066816:0@lo:400: 00000100:00100000:1.0:1788581169.474893:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581169.474923:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066432 00000100:00100000:1.0:1788581169.474930:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066432 00000100:00100000:1.0:1788581169.474975:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581169.474983:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040aae94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3621:x1875463184066432:12345-0@lo:400: 00000100:00100000:1.0:1788581169.475031:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040aae94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3621:x1875463184066432:12345-0@lo:400: Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581169.475039:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581169.475070:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066816 00000100:00100000:1.0:1788581169.475074:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066816 00000100:00100000:1.0:1788581169.475100:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581169.475106:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0eb2665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184066816:12345-0@lo:400: 00000100:00100000:1.0:1788581169.475137:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0eb2665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184066816:12345-0@lo:400: Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581169.475143:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581169.475181:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e1284369 x1875463184066816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581169.475194:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1284369 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184066816:0@lo:400: 00000100:00100000:1.0:1788581169.475203:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011888aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184066432:0@lo:400: 00000100:00100000:0.0:1788581169.475338:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581169.475368:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581169.475375:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b68eb189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184066688:0@lo:400: 00000100:00100000:0.0:1788581169.475399:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581169.475429:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066688 00000100:00100000:0.0:1788581169.475433:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066688 00000100:00100000:0.0:1788581169.475458:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581169.475465:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e751602f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184066688:12345-0@lo:400: 00000100:00100000:0.0:1788581169.475503:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e751602f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184066688:12345-0@lo:400: Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581169.475510:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581169.475533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b68eb189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184066688:0@lo:400: 00000100:00100000:1.0:1788581169.477044:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066560 00000100:00100000:1.0:1788581169.477056:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066560 00000100:00100000:1.0:1788581169.477096:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581169.477103:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac0b4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184066560:12345-0@lo:400: 00000100:00100000:1.0:1788581169.477171:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac0b4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184066560:12345-0@lo:400: Request processed in 69us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581169.477177:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788581169.477457:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d2c1b22c x1875463184066560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581169.477471:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2c1b22c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184066560:0@lo:400: 00000100:00100000:0.0:1788581169.477811:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581169.477824:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf41a8af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184066944:0@lo:41: 00000100:00100000:0.0:1788581169.477877:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581169.479043:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184066944 00000100:00100000:3.0:1788581169.479054:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184066944 00000100:00100000:3.0:1788581169.479102:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581169.479111:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2c1b22c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184066944:12345-0@lo:41: 00000004:00000024:3.0:1788581169.479155:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788581169.479214:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2c1b22c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184066944:12345-0@lo:41: Request processed in 103us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581169.479225:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581169.479876:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf41a8af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184066944:0@lo:41: 00000020:00000004:2.0:1788581169.827685:0:7747:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581169.827859:0:7747:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581169.857498:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581170.881455:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581171.905490:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581172.048336:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581172.048343:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4f1e6000 from 4 10000000:01000000:2.0:1788581172.048348:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581172.048720:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.048745:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.048756:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.048779:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067072:0@lo:101: 00000100:00100000:2.0:1788581172.048845:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.048895:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e79f19cf going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.048936:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067072 00000100:00100000:3.0:1788581172.048943:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067072 00000100:00100000:3.0:1788581172.048991:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581172.048998:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000812bac0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:6490:x1875463184067072:12345-0@lo:101: 00010000:00010000:3.0:1788581172.049009:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.049020:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f83e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.049040:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.049049:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da83a2fd/0x50f0cc74b7b2f845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.049063:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da83a2fd, rc 0) 00000100:00100000:3.0:1788581172.049105:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000812bac0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:6490:x1875463184067072:12345-0@lo:101: Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.049112:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581172.049586:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067072:0@lo:101: 00010000:00010000:3.0:1788581172.049600:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.049609:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.049664:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de495530 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067200:0@lo:256: 00000100:00100000:3.0:1788581172.049702:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581172.049727:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fc839d9 going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.049739:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067200 00000100:00100000:3.0:1788581172.049743:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067200 00000100:00100000:3.0:1788581172.049781:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788581172.049788:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1cdcc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:6490:x1875463184067200:12345-0@lo:256: 20000000:01000000:3.0:1788581172.049801:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581172.050800:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581172.050805:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788581172.051009:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1cdcc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:6490:x1875463184067200:12345-0@lo:256: Request processed in 1220us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.051016:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581172.051089:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de495530 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067200:0@lo:256: 10000000:01000000:0.0:1788581172.051136:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581172.051143:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.051153:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000c1a62e88/0x50f0cc74b7b2f83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581172.051163:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581172.051166:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3a800 from 21 10000000:01000000:0.0:1788581172.051168:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581172.051193:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.051201:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.051208:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581172.051584:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b68eb189 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067328:0@lo:101: 00000100:00100000:0.0:1788581172.051693:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581172.051739:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000218cfe2e going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.051839:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067328 00000100:00100000:3.0:1788581172.051846:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067328 00000100:00100000:3.0:1788581172.051895:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788581172.051904:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002297ec41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:6490:x1875463184067328:12345-0@lo:101: 00010000:00010000:3.0:1788581172.051916:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.051940:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab91e904/0x50f0cc74b7b2f853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f84c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.051962:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab91e904/0x50f0cc74b7b2f853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.051972:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab91e904/0x50f0cc74b7b2f853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.051979:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab91e904, rc 0) 00000100:00100000:3.0:1788581172.052012:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002297ec41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067328:12345-0@lo:101: Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.052017:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788581172.052048:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b68eb189 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067328:0@lo:101: 00010000:00010000:3.0:1788581172.052059:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.052066:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.052121:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7181d86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067456:0@lo:501: 00000100:00100000:3.0:1788581172.053796:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581172.053832:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013956d6c going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.053852:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067456 00000100:00100000:3.0:1788581172.053857:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067456 00000100:00100000:3.0:1788581172.053892:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788581172.053909:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f289b572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067456:12345-0@lo:501: 00000100:00100000:3.0:1788581172.054030:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f289b572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067456:12345-0@lo:501: Request processed in 123us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.054037:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788581172.054073:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7181d86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067456:0@lo:501: 00000100:00100000:3.0:1788581172.054108:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7181d86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067584:0@lo:503: 00000100:00100000:3.0:1788581172.054142:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581172.054153:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013956d6c going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.054163:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067584 00000100:00100000:3.0:1788581172.054166:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067584 00000100:00100000:3.0:1788581172.054183:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581172.054187:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac1bf5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067584:12345-0@lo:503: 00000100:00100000:3.0:1788581172.054283:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac1bf5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067584:12345-0@lo:503: Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.054290:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581172.054332:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7181d86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067584:0@lo:503: 00000100:00100000:2.0:1788581172.060313:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7834:1875463184067712:0@lo:502: 00000100:00100000:2.0:1788581172.060409:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.060450:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set 000000002aa63317 going to sleep for 11 seconds 00000100:00100000:1.0:1788581172.060626:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067712 00000100:00100000:1.0:1788581172.060634:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067712 00000100:00100000:1.0:1788581172.060679:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581172.060687:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000879277d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7834:x1875463184067712:12345-0@lo:502: 00000100:00100000:1.0:1788581172.060899:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000879277d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7834:x1875463184067712:12345-0@lo:502: Request processed in 213us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.060907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788581172.060987:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7834:1875463184067712:0@lo:502: 00000100:00100000:2.0:1788581172.061029:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7834:1875463184067840:0@lo:502: 00000100:00100000:2.0:1788581172.061058:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.061086:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set 000000002aa63317 going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.061124:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067840 00000100:00100000:0.0:1788581172.061129:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067840 00000100:00100000:0.0:1788581172.061170:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581172.061176:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a5b1c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7834:x1875463184067840:12345-0@lo:502: 00000100:00100000:0.0:1788581172.061284:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a5b1c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:7834:x1875463184067840:12345-0@lo:502: Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581172.061292:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581172.061395:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7834:1875463184067840:0@lo:502: 00000040:00080000:1.0:1788581172.061413:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788581172.061563:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788581172.061587:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581172.061594:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.061604:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000044b773df/0x50f0cc74b7b2f84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581172.061613:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788581172.061615:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3a800 from 4 10000000:01000000:0.0:1788581172.061617:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581172.061639:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.061646:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.061653:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581172.061664:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002796d5ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067968:0@lo:101: 00000100:00100000:0.0:1788581172.061691:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581172.061718:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000312d88b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788581172.061755:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184067968 00000100:00100000:1.0:1788581172.061826:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184067968 00000100:00100000:1.0:1788581172.061854:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581172.061859:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b42588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184067968:12345-0@lo:101: 00010000:00010000:1.0:1788581172.061868:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581172.061877:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031a6ef19/0x50f0cc74b7b2f861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f85a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.061893:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031a6ef19/0x50f0cc74b7b2f861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.061913:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031a6ef19/0x50f0cc74b7b2f861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.061920:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031a6ef19, rc 0) 00000100:00100000:1.0:1788581172.061954:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b42588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184067968:12345-0@lo:101: Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.061960:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581172.062032:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002796d5ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184067968:0@lo:101: 00010000:00010000:2.0:1788581172.062042:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.062049:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.062087:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068096:0@lo:256: 00000100:00100000:2.0:1788581172.062111:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.062136:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000006125104b going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.062168:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068096 00000100:00100000:0.0:1788581172.062171:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068096 00000100:00100000:0.0:1788581172.062200:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581172.062205:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0817c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184068096:12345-0@lo:256: 20000000:01000000:0.0:1788581172.062226:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581172.062240:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581172.062243:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788581172.062332:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0817c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184068096:12345-0@lo:256: Request processed in 127us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581172.062338:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581172.062399:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068096:0@lo:256: 10000000:01000000:2.0:1788581172.062436:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581172.062441:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.062447:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000008a93869a/0x50f0cc74b7b2f85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581172.062454:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788581172.062455:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788581172.062457:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581172.062470:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.062476:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.062482:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.062491:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068224:0@lo:101: 00000100:00100000:2.0:1788581172.062513:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.062530:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000006125104b going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.062567:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068224 00000100:00100000:0.0:1788581172.062571:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068224 00000100:00100000:0.0:1788581172.062599:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581172.062605:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9e6393f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184068224:12345-0@lo:101: 00010000:00010000:0.0:1788581172.062611:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581172.062618:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000203bb4e5/0x50f0cc74b7b2f86f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f868 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.062631:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000203bb4e5/0x50f0cc74b7b2f86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.062637:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000203bb4e5/0x50f0cc74b7b2f86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.062643:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000203bb4e5, rc 0) 00000100:00100000:0.0:1788581172.062669:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9e6393f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184068224:12345-0@lo:101: Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581172.062674:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581172.062729:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068224:0@lo:101: 00010000:00010000:2.0:1788581172.062737:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.062744:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.062805:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068352:0@lo:501: 00000100:00100000:2.0:1788581172.062829:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.062849:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000006125104b going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.062861:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068352 00000100:00100000:2.0:1788581172.062864:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068352 00000100:00100000:2.0:1788581172.062880:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581172.062885:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000173de2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184068352:12345-0@lo:501: 00000100:00100000:2.0:1788581172.062986:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000173de2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184068352:12345-0@lo:501: Request processed in 100us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.062992:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581172.063018:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068352:0@lo:501: 00000100:00100000:2.0:1788581172.063039:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068480:0@lo:503: 00000100:00100000:2.0:1788581172.063078:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.063090:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000006125104b going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.063099:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068480 00000100:00100000:2.0:1788581172.063102:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068480 00000100:00100000:2.0:1788581172.063117:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581172.063121:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b8d5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184068480:12345-0@lo:503: 00000100:00100000:2.0:1788581172.063191:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b8d5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184068480:12345-0@lo:503: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.063197:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581172.063237:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184068480:0@lo:503: 00000100:00100000:2.0:1788581172.063406:0:7835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7835:1875463184068608:0@lo:502: 00000100:00100000:2.0:1788581172.063436:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.063458:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068608 00000100:00100000:2.0:1788581172.063462:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068608 00000100:00100000:2.0:1788581172.063479:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581172.063484:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a5dfeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:7835:x1875463184068608:12345-0@lo:502: 00000100:00100000:2.0:1788581172.063542:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a5dfeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:7835:x1875463184068608:12345-0@lo:502: Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.063548:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581172.063570:0:7835:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fc699df going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.063579:0:7835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7835:1875463184068608:0@lo:502: 00000020:01000000:2.0:1788581172.063595:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581172.063603:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581172.063605:0:7835:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788581172.063609:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581172.063612:0:7835:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1788581172.063631:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581172.063644:0:7835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000f06a9bd9) 00000020:00000080:2.0:1788581172.063661:0:7835:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788581172.063666:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581172.063743:0:7835:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788581172.063748:0:7835:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788581172.063755:0:7835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f87d 00010000:00080000:2.0:1788581172.063781:0:7835:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e0c7d818@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581172.065473:0:7835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788581172.074557:0:7835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581172.074571:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788581172.074602:0:7835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788581172.074621:0:7835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2f884 00000100:00080000:2.0:1788581172.074630:0:7835:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581172.074634:0:7835:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000e0c7d818 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581172.074671:0:7835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005b8f3592 x1875463184068736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581172.074702:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184068736:0@lo:38: 00000100:00100000:2.0:1788581172.074842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581172.074892:0:7835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788581172.074965:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184068864:0@lo:400: 00000100:00100000:2.0:1788581172.074992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.075012:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581172.075017:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184068992:0@lo:400: 00000100:00100000:2.0:1788581172.075046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.075075:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184069120:0@lo:400: 00000100:00100000:2.0:1788581172.075097:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.075130:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068864 00000100:00100000:2.0:1788581172.075136:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068864 00000100:00100000:2.0:1788581172.075164:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069120 00000100:00100000:2.0:1788581172.075166:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069120 00000100:00100000:2.0:1788581172.075182:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581172.075189:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f80f61c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184068864:12345-0@lo:400: 00000100:00100000:2.0:1788581172.075249:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f80f61c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184068864:12345-0@lo:400: Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.075389:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581172.075403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581172.075409:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2465ce3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184069120:12345-0@lo:400: 00000100:00100000:2.0:1788581172.075441:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2465ce3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184069120:12345-0@lo:400: Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.075447:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581172.075471:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068736 00000100:00100000:2.0:1788581172.075475:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068736 00000100:00100000:2.0:1788581172.075489:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184068992 00000100:00100000:2.0:1788581172.075492:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184068992 00000100:00100000:2.0:1788581172.075507:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581172.075523:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a5bb71e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184068736:12345-0@lo:38: 00010000:00080000:2.0:1788581172.075543:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:2.0:1788581172.075573:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2f88b 00000004:00100000:2.0:1788581172.075586:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788581172.075591:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:2.0:1788581172.075672:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b3933676 x1875463184068864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581172.075684:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3933676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184068864:0@lo:400: 00010000:00080000:2.0:1788581172.075706:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000808b2547 x1875463184069120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581172.075714:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000808b2547 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184069120:0@lo:400: 00000100:00100000:2.0:1788581172.075730:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581172.075736:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096de6714 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184068992:12345-0@lo:400: 00000100:00100000:2.0:1788581172.076069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096de6714 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184068992:12345-0@lo:400: Request processed in 333us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.076077:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581172.076105:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020d90748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184068992:0@lo:400: 00000040:01000000:2.0:1788581172.076137:0:7835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788581172.076681:0:7839:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000003eaf4693 x1875463184069248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581172.076691:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032f0a826 going to sleep for 0 seconds 00000020:01000000:2.0:1788581172.076787:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581172.076793:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581172.076795:0:7835:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788581172.076810:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581172.076814:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581172.076815:0:7835:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581172.076818:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581172.076819:0:7835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788581172.076841:0:7835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7835:1875463184069376:0@lo:502: 00000100:00100000:2.0:1788581172.076884:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.076908:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069376 00000100:00100000:2.0:1788581172.076911:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069376 00000100:00100000:2.0:1788581172.076947:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581172.076954:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b66b849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:7835:x1875463184069376:12345-0@lo:502: 00000100:00100000:2.0:1788581172.077042:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b66b849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:7835:x1875463184069376:12345-0@lo:502: Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.077048:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581172.077087:0:7835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8bf5b9d going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.077100:0:7835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:7835:1875463184069376:0@lo:502: 00000020:01000000:2.0:1788581172.077122:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581172.077125:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581172.077126:0:7835:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581172.077129:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788581172.077177:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788581172.077194:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581172.077202:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.077222:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000099e91cb0/0x50f0cc74b7b2f868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581172.077231:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581172.077238:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7557cd28 from 1 10000000:01000000:2.0:1788581172.077241:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581172.077280:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.077288:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.077295:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.077305:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184069504:0@lo:101: 00000100:00100000:2.0:1788581172.077330:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.077346:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf1b85ff going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.077515:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069504 00000100:00100000:0.0:1788581172.077521:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069504 00000100:00100000:0.0:1788581172.077551:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788581172.077556:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046174b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184069504:12345-0@lo:101: 00010000:00010000:0.0:1788581172.077565:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581172.077576:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f892 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.077594:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.077603:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df875ba3/0x50f0cc74b7b2f899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.077610:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df875ba3, rc 0) 00000100:00100000:0.0:1788581172.077640:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046174b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184069504:12345-0@lo:101: Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581172.077645:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581172.077709:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184069504:0@lo:101: 00010000:00010000:2.0:1788581172.077721:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.077728:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.077831:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184069632:0@lo:501: 00000100:00100000:2.0:1788581172.077857:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581172.078879:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf1b85ff going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.081703:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069632 00000100:00100000:0.0:1788581172.081715:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069632 00000100:00100000:0.0:1788581172.081771:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581172.081779:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb27917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184069632:12345-0@lo:501: 00000100:00100000:0.0:1788581172.081894:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb27917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184069632:12345-0@lo:501: Request processed in 115us (4036us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581172.081900:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581172.082172:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184069632:0@lo:501: 10000000:01000000:2.0:1788581172.082223:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581172.082230:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581172.082250:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000055d74059/0x50f0cc74b7b2f892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788581172.091063:0:6499:0:(import.c:65:import_set_state_nolock()) 000000003b2d3151 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581172.091152:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a5bb71e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184068736:12345-0@lo:38: Request processed in 15638us (16309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.091162:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581172.091234:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581172.091243:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788581172.091250:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788581172.091274:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788581172.091277:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000e0c7d818 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788581172.091290:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000032f0a826): req@000000003eaf4693 x1875463184069248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581172.091306:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8f3592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184068736:0@lo:38: 00000100:00100000:1.0:1788581172.091367:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.091392:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069248 00000100:00100000:1.0:1788581172.091534:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069248 00000100:00100000:1.0:1788581172.091581:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581172.091590:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4fe4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184069248:12345-0@lo:1000: 00000100:00100000:1.0:1788581172.091654:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4fe4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184069248:12345-0@lo:1000: Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.091671:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581172.091710:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003eaf4693 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184069248:0@lo:1000: 00000040:01000000:1.0:1788581172.091739:0:7839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788581172.091782:0:7839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184069888:0@lo:1000: 00000100:00100000:1.0:1788581172.091808:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.091826:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069888 00000100:00100000:1.0:1788581172.091829:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069888 00000100:00100000:1.0:1788581172.091849:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581172.091855:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04d0c86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184069888:12345-0@lo:1000: 00000100:00100000:1.0:1788581172.091929:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04d0c86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184069888:12345-0@lo:1000: Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.091936:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581172.091952:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070ff2b4f going to sleep for 11 seconds 00000100:00100000:1.0:1788581172.091962:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184069888:0@lo:1000: 00000100:00100000:1.0:1788581172.091996:0:7839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070016:0@lo:700: 00000100:00100000:1.0:1788581172.092018:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.092038:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012f2d9a0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.092153:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070016 00000100:00100000:3.0:1788581172.092157:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070016 00000100:00100000:3.0:1788581172.092192:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581172.092198:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002602e8b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184070016:12345-0@lo:700: 00000100:00100000:3.0:1788581172.092243:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002602e8b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184070016:12345-0@lo:700: Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.092249:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581172.092691:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070016:0@lo:700: 00000100:00100000:1.0:1788581172.092887:0:7839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070144:0@lo:1000: 00000100:00100000:1.0:1788581172.092915:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.092938:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5dceb62 going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.092975:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070144 00000100:00100000:3.0:1788581172.092979:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070144 00000100:00100000:3.0:1788581172.093008:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581172.093022:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be7024f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184070144:12345-0@lo:1000: 00000100:00100000:3.0:1788581172.093069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be7024f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184070144:12345-0@lo:1000: Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.093075:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581172.093129:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070144:0@lo:1000: 00000004:00080000:1.0:1788581172.093164:0:7839:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000012f2d9a0 with version 0 00000020:00100000:1.0:1788581172.093176:0:7839:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788581172.093182:0:7839:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000012818bf8 x1875463184070400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581172.093198:0:7839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070400:0@lo:1000: 00000100:00100000:1.0:1788581172.093231:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.093274:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000076e0706 going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.093581:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070400 00000100:00100000:3.0:1788581172.093586:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070400 00000100:00100000:3.0:1788581172.093726:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581172.093733:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6040d64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1875463184070400:12345-0@lo:1000: 00000100:00100000:1.0:1788581172.094312:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e652dcc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184069760:0@lo:41: 00000100:00100000:1.0:1788581172.094360:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581172.094536:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184069760 00000100:00100000:3.0:1788581172.094541:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184069760 00000100:00100000:3.0:1788581172.094574:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581172.094581:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ace162da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3621:x1875463184069760:12345-0@lo:41: 00000004:00000024:3.0:1788581172.094601:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788581172.094640:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ace162da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3621:x1875463184069760:12345-0@lo:41: Request processed in 60us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.094645:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581172.094712:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e652dcc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184069760:0@lo:41: 00000001:00080000:0.0:1788581172.110714:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788581172.110727:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788581172.120662:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6040d64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7839:x1875463184070400:12345-0@lo:1000: Request processed in 26923us (27424us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788581172.120678:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788581172.120902:0:7839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788581172.120908:0:7839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788581172.120935:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012818bf8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070400:0@lo:1000: 00000100:00100000:0.0:1788581172.121013:0:7839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070528:0@lo:1000: 00000100:00100000:0.0:1788581172.121050:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581172.121094:0:7839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062c39da9 going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.121285:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070528 00000100:00100000:2.0:1788581172.121293:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070528 00000100:00100000:2.0:1788581172.121332:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581172.121339:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099edfcb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1875463184070528:12345-0@lo:1000: 00000100:00100000:2.0:1788581172.122591:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099edfcb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1875463184070528:12345-0@lo:1000: Request processed in 1249us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581172.122601:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581172.122742:0:7839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1875463184070528:0@lo:1000: 00000040:00080000:0.0:1788581172.122843:0:7839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788581172.122884:0:7839:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001a6d20e8 with version 1 00000004:00080000:1.0:1788581172.124138:0:7836:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002aa63317 version 1 rpc_version 1 00000020:00100000:1.0:1788581172.124173:0:7836:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788581172.124182:0:7836:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003d2a2905 x1875463184070784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581172.124203:0:7836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d2a2905 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7836:1875463184070784:0@lo:1000: 00000100:00100000:1.0:1788581172.124295:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.124334:0:7836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c72df810 going to sleep for 11 seconds 00000100:00100000:3.0:1788581172.125548:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070784 00000100:00100000:3.0:1788581172.125559:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070784 00000100:00100000:3.0:1788581172.125619:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581172.125628:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000976e2422 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7836:x1875463184070784:12345-0@lo:1000: 00000001:00080000:3.0:1788581172.130869:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788581172.131028:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000976e2422 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7836:x1875463184070784:12345-0@lo:1000: Request processed in 5398us (6730us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788581172.131041:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788581172.131123:0:7836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788581172.131128:0:7836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788581172.131145:0:7836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d2a2905 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7836:1875463184070784:0@lo:1000: 00000040:00080000:0.0:1788581172.133203:0:7839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788581172.133308:0:7839:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788581172.133313:0:7839:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788581172.189892:0:7853:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581172.190158:0:7853:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581172.929739:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788581173.271517:0:7901:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5fd84200 20000000:00000080:2.0:1788581173.271536:0:7901:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e7556e000 uarg=0000000000000000 20000000:01000000:2.0:1788581173.271577:0:7901:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788581173.271584:0:7901:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788581173.271599:0:7901:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788581173.271671:0:7901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788581173.271686:0:7901:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788581173.280145:0:7901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581173.281092:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788581173.281125:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788581173.281140:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788581173.281156:0:7901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581173.281172:0:7901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281200:0:7901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281223:0:7901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281231:0:7901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281287:0:7901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281301:0:7901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 17 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.281313:0:7901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875463184070912:0@lo:104: 00000100:00100000:2.0:1788581173.281378:0:7901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581173.281445:0:7901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.281452:0:7901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.281459:0:7901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3cbce16 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875463184071040:0@lo:104: 00000100:00100000:2.0:1788581173.281479:0:7901:0:(client.c:2715:ptlrpc_set_wait()) set 000000008419e816 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.281698:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788581173.281717:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581173.281836:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184070912 00000100:00100000:3.0:1788581173.281850:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184070912 00000100:00100000:0.0:1788581173.282342:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071040 00000100:00100000:0.0:1788581173.282347:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071040 00000100:00100000:0.0:1788581173.282372:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581173.282380:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a018fdb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:7901:x1875463184070912:12345-0@lo:104: 00010000:00010000:0.0:1788581173.282392:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.282506:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581173.282511:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a018fdb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:7901:x1875463184070912:12345-0@lo:104: Request processed in 133us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.282518:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581173.282555:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581173.282561:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7181d86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:7901:x1875463184071040:12345-0@lo:104: 00010000:00010000:0.0:1788581173.282569:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284211:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581173.284220:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7181d86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:7901:x1875463184071040:12345-0@lo:104: Request processed in 1658us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.284229:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788581173.284276:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581173.284282:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284290:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c62fbf90 already unused, calling callback (000000002a7d193f) 10000000:00010000:0.0:1788581173.284294:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284303:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581173.284310:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581173.284316:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581173.284348:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284356:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581173.284370:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284376:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000c62fbf90/0x50f0cc74b7b2f806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f80d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284402:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581173.284405:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284410:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000337542f4 already unused, calling callback (000000002a7d193f) 10000000:00010000:0.0:1788581173.284413:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284418:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581173.284423:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581173.284428:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581173.284441:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284447:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581173.284451:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284456:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000337542f4/0x50f0cc74b7b2f718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f71f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.284468:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581173.284470:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581173.284471:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581173.286397:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581173.286430:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184071168:0@lo:103: 00000100:00100000:2.0:1788581173.286499:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581173.286557:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581173.286563:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184071296:0@lo:103: 00000100:00100000:2.0:1788581173.286582:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581173.286911:0:7901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003196f8ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875463184070912:0@lo:104: 00000100:00100000:1.0:1788581173.286923:0:7901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3cbce16 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875463184071040:0@lo:104: 00010000:00010000:1.0:1788581173.286945:0:7901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.287403:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071168 00000100:00100000:0.0:1788581173.287418:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071168 00010000:00010000:0.0:1788581173.287521:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 18 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.287592:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071296 00000100:00100000:0.0:1788581173.287596:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071296 00010000:00010000:0.0:1788581173.287610:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 19 pid: 6486 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.287791:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581173.287800:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b42431 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3618:x1875463184071168:12345-0@lo:103: 00010000:00010000:0.0:1788581173.287812:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581173.287817:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 19 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287826:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 19 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287840:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008379cfc2/0x50f0cc74b7b2f80d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f806 expref: 19 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287852:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581173.287897:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b42431 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:3618:x1875463184071168:12345-0@lo:103: Request processed in 98us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.287903:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581173.287917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581173.287923:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345c35d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3618:x1875463184071296:12345-0@lo:103: 00010000:00010000:0.0:1788581173.287929:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581173.287933:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287950:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287959:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e983346c/0x50f0cc74b7b2f71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f718 expref: 17 pid: 6486 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287968:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287975:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287986:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287993:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.287998:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.288004:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.288009:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000278cd532 already unused, calling callback (00000000b3b830f6) 00010000:00010000:0.0:1788581173.288012:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.288018:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.288040:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.288048:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581173.288070:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345c35d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184071296:12345-0@lo:103: Request processed in 148us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.288076:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581173.288239:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184071296:0@lo:103: 00000100:00100000:0.0:1788581173.288247:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184071168:0@lo:103: 00010000:00010000:1.0:1788581173.288707:0:7901:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.288727:0:7901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.288732:0:7901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000278cd532/0x50f0cc74b7b2f8a0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.953549:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581174.594041:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581174.594066:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184071424:0@lo:41: 00000100:00100000:1.0:1788581174.594133:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581174.594716:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071424 00000100:00100000:3.0:1788581174.594724:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071424 00000100:00100000:3.0:1788581174.594774:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581174.594783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083d03109 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184071424:12345-0@lo:41: 00000004:00000024:3.0:1788581174.594813:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788581174.594868:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083d03109 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184071424:12345-0@lo:41: Request processed in 86us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581174.594876:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581174.601555:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184071424:0@lo:41: 00010000:00010000:2.0:1788581174.980675:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581176.001715:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581177.027427:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581177.153873:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184071680:0@lo:400: 00000100:00100000:0.0:1788581177.153944:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154013:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184072192:0@lo:400: 00000100:00100000:0.0:1788581177.154047:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154082:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581177.154088:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a15b5fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184072064:0@lo:400: 00000100:00100000:0.0:1788581177.154122:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154160:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072ef2b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184071808:0@lo:400: 00000100:00100000:0.0:1788581177.154211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015c6dc6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184071552:0@lo:41: 00000100:00100000:0.0:1788581177.154322:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154340:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581177.154345:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520dd30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184071936:0@lo:400: 00000100:00100000:0.0:1788581177.154368:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581177.154408:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072192 00000100:00100000:0.0:1788581177.154415:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072192 00000100:00100000:0.0:1788581177.154451:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071552 00000100:00100000:0.0:1788581177.154454:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071552 00000100:00100000:0.0:1788581177.154466:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071936 00000100:00100000:0.0:1788581177.154468:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071936 00000100:00100000:0.0:1788581177.154481:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581177.154489:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e652dcc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184072192:12345-0@lo:400: 00000100:00100000:0.0:1788581177.154548:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e652dcc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184072192:12345-0@lo:400: Request processed in 59us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.154555:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581177.154579:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581177.154585:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68eb189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184071552:12345-0@lo:41: 00000004:00000024:0.0:1788581177.154606:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788581177.154637:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68eb189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184071552:12345-0@lo:41: Request processed in 54us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.154643:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581177.154653:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581177.154658:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011888aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184071936:12345-0@lo:400: 00000100:00100000:0.0:1788581177.154680:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011888aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184071936:12345-0@lo:400: Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.154685:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581177.154705:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072064 00000100:00100000:0.0:1788581177.154708:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072064 00000100:00100000:0.0:1788581177.154729:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071808 00000100:00100000:0.0:1788581177.154731:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071808 00000100:00100000:0.0:1788581177.154742:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581177.154747:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eaf4693 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184072064:12345-0@lo:400: 00000100:00100000:0.0:1788581177.154782:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eaf4693 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184072064:12345-0@lo:400: Request processed in 35us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.154788:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581177.154797:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581177.154802:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002796d5ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184071808:12345-0@lo:400: 00000100:00100000:0.0:1788581177.154836:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002796d5ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184071808:12345-0@lo:400: Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.154848:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581177.154895:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520dd30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184071936:0@lo:400: 00010000:00080000:0.0:1788581177.154913:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000072ef2b88 x1875463184071808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581177.154922:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072ef2b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184071808:0@lo:400: 00000100:00100000:0.0:1788581177.154936:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015c6dc6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184071552:0@lo:41: 00010000:00080000:0.0:1788581177.154980:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a15b5fa x1875463184072064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581177.154988:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a15b5fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184072064:0@lo:400: 00000100:00100000:0.0:1788581177.154996:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e621a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184072192:0@lo:400: 00000100:00100000:2.0:1788581177.156229:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184071680 00000100:00100000:2.0:1788581177.156241:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184071680 00000100:00100000:2.0:1788581177.156308:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581177.156318:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3621:x1875463184071680:12345-0@lo:400: 00000100:00100000:2.0:1788581177.156392:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3621:x1875463184071680:12345-0@lo:400: Request processed in 77us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581177.156399:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788581177.156407:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184071680:0@lo:400: 00010000:00010000:2.0:1788581178.053284:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581179.073345:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581179.714839:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184072320:0@lo:41: 00000100:00100000:2.0:1788581179.714913:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581179.716773:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072320 00000100:00100000:3.0:1788581179.716787:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072320 00000100:00100000:3.0:1788581179.716859:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581179.716876:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025da8ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184072320:12345-0@lo:41: 00000004:00000024:3.0:1788581179.716914:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788581179.716996:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025da8ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184072320:12345-0@lo:41: Request processed in 129us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581179.717003:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581179.717049:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000350e477f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184072320:0@lo:41: 00010000:00010000:0.0:1788581180.097442:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788581180.218926:0:8399:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788581180.218931:0:8399:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788581180.218932:0:8399:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788581180.219061:0:8399:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ea7710f0 00000020:01000004:1.0:1788581180.219076:0:8399:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788581180.219088:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788581180.219100:0:8399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000377578f9) 00000020:00000080:1.0:1788581180.219115:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 10000000:01000000:2.0:1788581180.227628:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581180.227634:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4f1e6000 from 1 10000000:01000000:2.0:1788581180.227638:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581180.227679:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.227692:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.227702:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.227725:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072448:0@lo:101: 00000100:00100000:2.0:1788581180.227795:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.227838:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000008145b02b going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.227857:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072448 00000100:00100000:2.0:1788581180.227864:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072448 00000100:00100000:2.0:1788581180.227906:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581180.227913:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004288c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184072448:12345-0@lo:101: 00010000:00010000:2.0:1788581180.227925:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581180.227937:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9059076/0x50f0cc74b7b2f8b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f8ae expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.227958:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9059076/0x50f0cc74b7b2f8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.227968:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9059076/0x50f0cc74b7b2f8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.227976:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9059076, rc 0) 00000100:00100000:2.0:1788581180.228007:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004288c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184072448:12345-0@lo:101: Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.228014:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581180.228105:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072448:0@lo:101: 00010000:00010000:2.0:1788581180.228120:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.228128:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000a34935bd/0x50f0cc74b7b2f8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.228197:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072576:0@lo:501: 00000100:00100000:2.0:1788581180.228228:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.228244:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000008145b02b going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.228272:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072576 00000100:00100000:2.0:1788581180.228276:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072576 00000100:00100000:2.0:1788581180.228296:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581180.228302:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024127405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184072576:12345-0@lo:501: 00000100:00100000:2.0:1788581180.228421:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024127405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184072576:12345-0@lo:501: Request processed in 119us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.228428:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581180.228456:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072576:0@lo:501: 00000100:00100000:2.0:1788581180.228482:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072704:0@lo:503: 00000100:00100000:2.0:1788581180.228518:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.228531:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000008145b02b going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.228542:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072704 00000100:00100000:2.0:1788581180.228544:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072704 00000100:00100000:2.0:1788581180.228566:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581180.228572:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae0d99e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184072704:12345-0@lo:503: 00000100:00100000:2.0:1788581180.228647:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae0d99e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184072704:12345-0@lo:503: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.228654:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581180.228688:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184072704:0@lo:503: 00000100:00100000:2.0:1788581180.228842:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8403:1875463184072832:0@lo:502: 00000100:00100000:2.0:1788581180.228871:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.228890:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072832 00000100:00100000:2.0:1788581180.228893:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072832 00000100:00100000:2.0:1788581180.228913:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581180.228924:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e62cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8403:x1875463184072832:12345-0@lo:502: 00000100:00100000:2.0:1788581180.228988:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e62cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8403:x1875463184072832:12345-0@lo:502: Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.228995:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581180.229020:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a996f4d8 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.229030:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009027ca9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8403:1875463184072832:0@lo:502: 00000020:01000000:2.0:1788581180.229048:0:8403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581180.229057:0:8403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581180.229060:0:8403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581180.229068:0:8403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4f1e6000 00000020:00000080:2.0:1788581180.229070:0:8403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788581180.229106:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8403:1875463184072960:0@lo:502: 00000100:00100000:2.0:1788581180.229136:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.229154:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184072960 00000100:00100000:2.0:1788581180.229171:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184072960 00000100:00100000:2.0:1788581180.229191:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581180.229196:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8403:x1875463184072960:12345-0@lo:502: 00000100:00100000:2.0:1788581180.229250:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8403:x1875463184072960:12345-0@lo:502: Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.229279:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581180.229304:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.229314:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8403:1875463184072960:0@lo:502: 00000020:01000000:2.0:1788581180.229329:0:8403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581180.229333:0:8403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581180.229334:0:8403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788581180.229337:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788581180.229388:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788581180.229411:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581180.229419:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229428:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581180.229437:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581180.229440:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3a800 from 1 10000000:01000000:2.0:1788581180.229443:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581180.229464:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229473:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229482:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.229505:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073088:0@lo:101: 00000100:00100000:3.0:1788581180.229531:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.229550:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.229902:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073088 00000100:00100000:2.0:1788581180.229907:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073088 00000100:00100000:2.0:1788581180.229930:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581180.229937:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184073088:12345-0@lo:101: 00010000:00010000:2.0:1788581180.229945:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581180.229955:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f8bc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229972:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229981:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.229995:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f800, rc 0) 00000100:00100000:3.0:1788581180.232475:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184073088:12345-0@lo:101: Request processed in 2517us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.232487:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581180.232565:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073088:0@lo:101: 00010000:00010000:3.0:1788581180.232586:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.232612:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.232702:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073216:0@lo:501: 00000100:00100000:3.0:1788581180.232733:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.232760:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.232774:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073216 00000100:00100000:3.0:1788581180.232780:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073216 00000100:00100000:3.0:1788581180.232811:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788581180.232819:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184073216:12345-0@lo:501: 00000100:00100000:3.0:1788581180.233119:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184073216:12345-0@lo:501: Request processed in 299us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.233127:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581180.233228:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073216:0@lo:501: 00000100:00100000:2.0:1788581180.233272:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073344:0@lo:503: 00000100:00100000:2.0:1788581180.233309:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.233338:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.233350:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073344 00000100:00100000:3.0:1788581180.233354:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073344 00000100:00100000:3.0:1788581180.233382:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581180.233390:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184073344:12345-0@lo:503: 00000100:00100000:2.0:1788581180.233471:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184073344:0@lo:503: 00000100:00100000:3.0:1788581180.233579:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184073344:12345-0@lo:503: Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.233588:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581180.233681:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8405:1875463184073472:0@lo:502: 00000100:00100000:3.0:1788581180.233713:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.233757:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.233768:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073472 00000100:00100000:2.0:1788581180.233772:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073472 00000100:00100000:2.0:1788581180.233793:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788581180.233799:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8405:x1875463184073472:12345-0@lo:502: 00000100:00100000:2.0:1788581180.233868:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8405:x1875463184073472:12345-0@lo:502: Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.233874:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581180.233914:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8405:1875463184073472:0@lo:502: 00000020:01000000:3.0:1788581180.233934:0:8405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581180.233946:0:8405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581180.233949:0:8405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788581180.233956:0:8405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4eb3a800 00000020:00000080:3.0:1788581180.233958:0:8405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788581180.233977:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8405:1875463184073600:0@lo:502: 00000100:00100000:3.0:1788581180.234008:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.234045:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.234066:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073600 00000100:00100000:2.0:1788581180.234070:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073600 00000100:00100000:2.0:1788581180.234091:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788581180.234097:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8405:x1875463184073600:12345-0@lo:502: 00000100:00100000:2.0:1788581180.234157:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8405:x1875463184073600:12345-0@lo:502: Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.234174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788581180.234320:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8405:1875463184073600:0@lo:502: 00000020:01000000:2.0:1788581180.234338:0:8405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581180.234342:0:8405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581180.234344:0:8405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788581180.234353:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788581180.234396:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788581180.234416:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581180.234424:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.234433:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1788581180.256925:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788581180.256990:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788581180.280434:0:8399:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788581180.280738:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788581180.280749:0:8399:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581180.280760:0:8399:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b2f8ca 00000020:01000004:2.0:1788581180.280768:0:8399:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788581180.280787:0:8399:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788581180.280790:0:8399:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788581180.280796:0:8399:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788581180.280800:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788581180.280810:0:8399:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff995e478719b8) 00000020:00000080:2.0:1788581180.280822:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788581180.284539:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581180.285521:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788581180.285528:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788581180.286237:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788581180.286245:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788581180.286733:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581180.286740:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788581180.289006:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581180.289203:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788581180.289209:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788581180.290890:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788581180.290901:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788581180.309184:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581180.309546:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788581180.309553:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788581180.313192:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581180.313205:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788581180.314866:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581180.314879:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788581180.317177:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581180.317401:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788581180.317407:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788581180.318081:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788581180.318088:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788581180.356534:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581180.356789:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581180.356796:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788581180.357993:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581180.358001:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788581180.358410:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788581180.358438:0:8399:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788581180.358443:0:8399:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788581180.371699:0:8399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788581180.371742:0:8399:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788581180.371746:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788581180.371752:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581180.371753:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581180.371754:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581180.371755:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581180.371756:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581180.371758:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581180.371760:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581180.371761:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581180.371763:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581180.371764:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581180.371767:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788581180.371770:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581180.371771:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581180.371772:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581180.371773:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581180.371774:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581180.371775:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581180.371776:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581180.371777:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581180.371778:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581180.371779:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581180.371780:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581180.371801:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788581180.371819:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184073728:0@lo:253: 00000100:00100000:1.0:1788581180.371895:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.372051:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.372107:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073728 00000100:00100000:2.0:1788581180.372115:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073728 00000100:00100000:2.0:1788581180.372208:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581180.372218:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8399:x1875463184073728:12345-0@lo:253: 20000000:01000000:2.0:1788581180.372244:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788581180.372249:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788581180.372297:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788581180.372300:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788581180.372507:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581180.372739:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788581180.372755:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788581180.372785:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788581180.372793:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788581180.372809:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788581180.372827:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788581180.372911:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788581180.372925:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:2.0:1788581180.372927:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788581180.372940:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788581180.372946:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788581180.372960:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788581180.372964:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1788581180.372975:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788581180.372981:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788581180.372992:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788581180.373005:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788581180.373066:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788581180.373076:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:2.0:1788581180.373078:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788581180.373091:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788581180.373096:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788581180.373108:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788581180.373113:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1788581180.373127:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788581180.373132:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788581180.373145:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788581180.373169:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788581180.373577:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788581180.373723:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:2.0:1788581180.373725:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788581180.373754:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788581180.373761:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788581180.373773:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788581180.373778:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1788581180.373790:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788581180.373796:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788581180.373806:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788581180.373820:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788581180.373831:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788581180.373834:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788581180.373838:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788581180.373877:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788581180.373880:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788581180.374357:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788581180.374576:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788581180.374662:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788581180.374679:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788581180.374686:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581180.374688:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581180.374934:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581180.374953:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581180.374966:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788581180.375086:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788581180.375104:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788581180.375119:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788581180.375127:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788581180.375129:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581180.375419:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581180.375441:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581180.375459:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788581180.375586:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788581180.375678:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788581180.375693:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788581180.375701:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788581180.375702:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581180.376013:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581180.376033:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581180.376048:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788581180.376205:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788581180.376223:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788581180.376383:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788581180.376405:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788581180.376423:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376441:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376448:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376455:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376463:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376470:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376477:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376514:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376529:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.376542:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184073856:0@lo:104: 00000100:00100000:2.0:1788581180.376667:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581180.376763:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376772:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 18 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.376781:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184073984:0@lo:104: 00000100:00100000:2.0:1788581180.376804:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581180.376878:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.376887:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.376896:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074112:0@lo:104: 00000100:00100000:2.0:1788581180.376917:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.376969:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073856 00000100:00100000:3.0:1788581180.376976:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073856 00000100:00100000:3.0:1788581180.377009:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184073984 00000100:00100000:3.0:1788581180.377012:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184073984 00000100:00100000:3.0:1788581180.377036:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581180.377044:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6488:x1875463184073856:12345-0@lo:104: 00010000:00010000:3.0:1788581180.377056:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377122:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581180.377129:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6488:x1875463184073856:12345-0@lo:104: Request processed in 86us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.377136:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581180.377153:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581180.377169:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6488:x1875463184073984:12345-0@lo:104: 00010000:00010000:3.0:1788581180.377176:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377210:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581180.377216:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6488:x1875463184073984:12345-0@lo:104: Request processed in 57us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.377221:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788581180.377238:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581180.377243:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377250:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581180.377283:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377292:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581180.377299:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.377305:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581180.377342:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377349:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581180.377367:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377373:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2f892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f899 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377385:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581180.377388:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377393:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581180.377396:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377403:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581180.377409:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.377414:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581180.377426:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377432:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581180.377437:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377451:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f86f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377460:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.377461:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.377463:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581180.377489:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184074240:0@lo:103: 00000100:00100000:3.0:1788581180.377514:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.377535:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581180.377540:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184074368:0@lo:103: 00000100:00100000:3.0:1788581180.377556:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.377580:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074240 00000100:00100000:3.0:1788581180.377584:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074240 00010000:00010000:3.0:1788581180.377669:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 19 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.377686:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074368 00000100:00100000:3.0:1788581180.377689:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074368 00010000:00010000:3.0:1788581180.377698:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 20 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.377713:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581180.377719:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184074240:12345-0@lo:103: 00010000:00010000:3.0:1788581180.377738:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581180.377744:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 20 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377754:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 20 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377774:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581180.377803:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184074240:12345-0@lo:103: Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.377809:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581180.377819:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581180.377825:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3620:x1875463184074368:12345-0@lo:103: 00010000:00010000:3.0:1788581180.377832:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581180.377836:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 19 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377844:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 19 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.377853:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581180.377872:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3620:x1875463184074368:12345-0@lo:103: Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.377878:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581180.377908:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184074368:0@lo:103: 00000100:00100000:3.0:1788581180.377915:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184074240:0@lo:103: 00010000:00010000:1.0:1788581180.378003:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581180.378200:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.378209:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 18 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.378219:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074496:0@lo:104: 00000100:00100000:2.0:1788581180.378242:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581180.378280:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.378288:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 18 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.378339:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074624:0@lo:104: 00000100:00100000:2.0:1788581180.378367:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.378377:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788581180.378389:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f892 expref: 18 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.378400:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184073856:0@lo:104: 00010000:00010000:2.0:1788581180.378409:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031e00/0x50f0cc74b7b2f86f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f868 expref: 17 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.378417:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184073984:0@lo:104: 00000100:00100000:3.0:1788581180.378475:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074112 00000100:00100000:3.0:1788581180.378480:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074112 00000100:00100000:3.0:1788581180.378499:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074496 00000100:00100000:3.0:1788581180.378501:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074496 00000100:00100000:3.0:1788581180.378509:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074624 00000100:00100000:3.0:1788581180.378511:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074624 00000100:00100000:3.0:1788581180.378521:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581180.378527:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6488:x1875463184074112:12345-0@lo:104: 00010000:00010000:3.0:1788581180.378540:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.378676:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074112:0@lo:104: 00010000:00010000:3.0:1788581180.378708:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581180.378714:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6488:x1875463184074112:12345-0@lo:104: Request processed in 187us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.378721:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581180.378734:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581180.378741:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6488:x1875463184074496:12345-0@lo:104: 00010000:00010000:3.0:1788581180.378748:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378828:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581180.378834:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378840:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581180.378844:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378851:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581180.378864:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581180.378869:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581180.378897:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378904:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581180.378920:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378926:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2f84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f853 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.378935:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581180.378937:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581180.378938:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581180.378949:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184074752:0@lo:103: 00000100:00100000:1.0:1788581180.378976:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.379008:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074752 00000100:00100000:1.0:1788581180.379012:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074752 00010000:00010000:1.0:1788581180.379028:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.379046:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581180.379053:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3618:x1875463184074752:12345-0@lo:103: 00010000:00010000:1.0:1788581180.379061:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581180.379065:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379080:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379092:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5e00/0x50f0cc74b7b2f853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f84c expref: 17 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379101:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581180.379127:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184074752:12345-0@lo:103: Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.379133:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581180.379170:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184074752:0@lo:103: 00010000:00010000:3.0:1788581180.379219:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581180.379225:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6488:x1875463184074496:12345-0@lo:104: Request processed in 485us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.379231:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581180.379245:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581180.379276:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6488:x1875463184074624:12345-0@lo:104: 00010000:00010000:3.0:1788581180.379284:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.379313:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581180.379318:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6488:x1875463184074624:12345-0@lo:104: Request processed in 67us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.379323:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788581180.379377:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581180.379382:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379389:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581180.379392:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379398:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581180.379404:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581180.379409:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581180.379424:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379439:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581180.379457:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379464:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6a800/0x50f0cc74b7b2f814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f81b expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379474:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581180.379477:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379482:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c2200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581180.379485:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379493:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581180.379499:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581180.379504:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581180.379516:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379522:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581180.379534:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379541:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2f79d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f7a4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379558:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581180.379560:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581180.379561:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581180.379567:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581180.379577:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184075008:0@lo:103: 00000100:00100000:1.0:1788581180.379611:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.379633:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075008 00000100:00100000:1.0:1788581180.379636:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075008 00010000:00010000:1.0:1788581180.379649:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.379668:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581180.379674:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3621:x1875463184075008:12345-0@lo:103: 00010000:00010000:1.0:1788581180.379680:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581180.379684:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379693:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.379702:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581180.379725:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3621:x1875463184075008:12345-0@lo:103: Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.379731:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581180.379753:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184075008:0@lo:103: 00010000:00010000:1.0:1788581180.379767:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581180.379891:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581180.379900:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184074880:0@lo:103: 00000100:00100000:3.0:1788581180.379934:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.380042:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184074880 00000100:00100000:1.0:1788581180.380052:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184074880 00010000:00010000:1.0:1788581180.380066:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 16 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.380091:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581180.380097:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7143b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184074880:12345-0@lo:103: 00010000:00010000:1.0:1788581180.380104:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581180.380107:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 16 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380115:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 16 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380126:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380133:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380144:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380150:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380168:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380175:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380180:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581180.380189:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380197:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380206:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.380215:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581180.380244:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7143b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184074880:12345-0@lo:103: Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.380250:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581180.380321:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184074880:0@lo:103: 00010000:00010000:2.0:1788581180.380565:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c3a00/0x50f0cc74b7b2f81b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f814 expref: 15 pid: 6487 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.380578:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074496:0@lo:104: 00010000:00010000:2.0:1788581180.380667:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2f7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f79d expref: 14 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.380676:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875463184074624:0@lo:104: 00010000:00010000:2.0:1788581180.380699:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.380708:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.380714:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.380720:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f8d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581180.380742:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788581180.382537:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:8399:x1875463184073728:12345-0@lo:253: Request processed in 10315us (10636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.382549:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581180.382664:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184073728:0@lo:253: 10000000:01000000:1.0:1788581180.382677:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581180.382680:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581180.382682:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581180.382683:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581180.382684:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788581180.382686:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581180.382687:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581180.382688:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581180.382690:0:8399:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788581180.382691:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581180.382692:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581180.382707:0:8399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e6f8e1800 from lustre-OST0000 10000000:01000000:1.0:1788581180.382732:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788581180.382734:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581180.382742:0:8399:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7557cd28 local copy 10000000:01000000:1.0:1788581180.382745:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788581180.382773:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.382790:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.382801:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.382816:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075136:0@lo:101: 00000100:00100000:1.0:1788581180.382848:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.382909:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.382943:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075136 00000100:00100000:2.0:1788581180.382949:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075136 00000100:00100000:2.0:1788581180.382990:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581180.382998:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:8399:x1875463184075136:12345-0@lo:101: 00010000:00010000:2.0:1788581180.383010:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581180.383021:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2f8e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f8df expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.383041:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2f8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8df expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.383051:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2f8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8df expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.383059:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581180.383122:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075136:12345-0@lo:101: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.383128:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581180.383220:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075136:0@lo:101: 00010000:00010000:1.0:1788581180.383232:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.383241:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.383551:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075264:0@lo:501: 00000100:00100000:1.0:1788581180.383575:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.383677:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.383812:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075264 00000100:00100000:2.0:1788581180.383816:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075264 00000100:00100000:2.0:1788581180.383849:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581180.383856:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075264:12345-0@lo:501: 00000100:00100000:2.0:1788581180.383955:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075264:12345-0@lo:501: Request processed in 99us (379us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581180.383970:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788581180.384056:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075264:0@lo:501: 10000000:01000000:1.0:1788581180.384068:0:8399:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788581180.384086:0:8399:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788581180.384092:0:8399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384100:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384112:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384176:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788581180.384196:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e6f8e1800 10000000:01000000:1.0:1788581180.384200:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581180.384205:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581180.384207:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581180.384211:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788581180.384213:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788581180.384229:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384238:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384246:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.384317:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075392:0@lo:101: 00000100:00100000:1.0:1788581180.384342:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.384448:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1788581180.384495:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581180.384502:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.384510:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ae00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581180.384514:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.384522:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581180.384529:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.384535:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581180.384553:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.384560:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581180.384582:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.384664:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184075520:0@lo:103: 00000100:00100000:1.0:1788581180.384690:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.384721:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075520 00000100:00100000:1.0:1788581180.384725:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075520 00000100:00100000:1.0:1788581180.384752:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581180.384758:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3621:x1875463184075520:12345-0@lo:103: 00010000:00010000:1.0:1788581180.384772:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581180.384783:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2f8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8df expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.384798:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581180.384824:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:3621:x1875463184075520:12345-0@lo:103: Request processed in 66us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.384830:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581180.384859:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184075520:0@lo:103: 00010000:00010000:3.0:1788581180.384896:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2f8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2f8e6 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.384907:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.384909:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.384911:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581180.384972:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075392 00000100:00100000:2.0:1788581180.384977:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075392 00000100:00100000:2.0:1788581180.385038:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788581180.385046:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+13:8399:x1875463184075392:12345-0@lo:101: 00010000:00010000:2.0:1788581180.385055:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581180.385067:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f8ed expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.385082:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.385090:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581180.385097:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00000100:00100000:2.0:1788581180.385136:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075392:12345-0@lo:101: Request processed in 91us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.385141:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788581180.385200:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075392:0@lo:101: 00010000:00010000:1.0:1788581180.385210:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.385218:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.385352:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075648:0@lo:501: 00000100:00100000:1.0:1788581180.385377:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.385585:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581180.385692:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075648 00000100:00100000:0.0:1788581180.385697:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075648 00000100:00100000:0.0:1788581180.385719:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581180.385724:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075648:12345-0@lo:501: 00000100:00100000:0.0:1788581180.385824:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075648:12345-0@lo:501: Request processed in 99us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.385830:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788581180.385887:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075648:0@lo:501: 00000100:00100000:1.0:1788581180.385930:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075776:0@lo:503: 00000100:00100000:1.0:1788581180.385963:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.385985:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581180.386023:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075776 00000100:00100000:0.0:1788581180.386027:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075776 00000100:00100000:0.0:1788581180.386045:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581180.386051:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075776:12345-0@lo:503: 00000100:00100000:0.0:1788581180.386128:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075776:12345-0@lo:503: Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.386135:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581180.386207:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075776:0@lo:503: 00000040:00080000:1.0:1788581180.386453:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581180.386516:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075904:0@lo:502: 00000100:00100000:1.0:1788581180.387341:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.387409:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.387500:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184075904 00000100:00100000:2.0:1788581180.387507:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184075904 00000100:00100000:0.0:1788581180.387559:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581180.387569:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075904:12345-0@lo:502: 00000100:00100000:0.0:1788581180.387727:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184075904:12345-0@lo:502: Request processed in 160us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.387734:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581180.387815:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184075904:0@lo:502: 00000040:00080000:1.0:1788581180.388016:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788581180.388042:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788581180.388058:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788581180.388072:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788581180.388085:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788581180.388098:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788581180.388122:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076032:0@lo:502: 00000100:00100000:1.0:1788581180.388167:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.388189:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581180.388230:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076032 00000100:00100000:0.0:1788581180.388234:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076032 00000100:00100000:0.0:1788581180.388294:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788581180.388302:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184076032:12345-0@lo:502: 00000100:00100000:0.0:1788581180.388365:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184076032:12345-0@lo:502: Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.388371:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581180.388491:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076032:0@lo:502: 00000040:00080000:1.0:1788581180.388525:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788581180.388531:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788581180.388956:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581180.388964:0:8424:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788581180.388970:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581180.388973:0:8424:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788581180.388978:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581180.389329:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff995d41c03370) 00000020:00000080:1.0:1788581180.389353:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788581180.389362:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581180.389441:0:8424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f8e1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788581180.389448:0:8424:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581180.389455:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b2f902 00010000:00010000:1.0:1788581180.394541:0:8424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788581180.394878:0:8424:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788581180.397572:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788581180.397886:0:8424:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788581180.401853:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788581180.402040:0:8424:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788581180.407202:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788581180.408363:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788581180.408374:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581180.408380:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581180.408382:0:8424:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788581180.408385:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581180.408390:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581180.408391:0:8424:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581180.408394:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581180.408396:0:8424:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788581180.408417:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581180.408420:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581180.408422:0:8424:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788581180.408425:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788581180.411957:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788581180.411996:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581180.412018:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.412030:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.412038:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f8e1800 from 1 10000000:01000000:3.0:1788581180.412040:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581180.412134:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.412142:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.412153:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.412184:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076160:0@lo:101: 00000100:00100000:3.0:1788581180.412336:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.412377:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581180.412437:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076160 00000100:00100000:1.0:1788581180.412445:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076160 00000100:00100000:1.0:1788581180.412491:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581180.412501:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:8399:x1875463184076160:12345-0@lo:101: 00010000:00010000:1.0:1788581180.412513:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581180.412525:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f909 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.412547:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.412557:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.412566:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a800, rc 0) 00000100:00100000:1.0:1788581180.412709:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076160:12345-0@lo:101: Request processed in 210us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.412716:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581180.413355:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076160:0@lo:101: 00010000:00010000:3.0:1788581180.413372:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.413382:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.413476:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076288:0@lo:501: 00000100:00100000:3.0:1788581180.413510:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.413586:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.414917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076288 00000100:00100000:2.0:1788581180.414925:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076288 00000100:00100000:2.0:1788581180.415010:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581180.415019:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076288:12345-0@lo:501: 00000100:00100000:2.0:1788581180.415171:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076288:12345-0@lo:501: Request processed in 153us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.415180:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581180.415290:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076288:0@lo:501: 00000100:00100000:0.0:1788581180.415335:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076416:0@lo:503: 00000100:00100000:0.0:1788581180.415380:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.415726:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076416 00000100:00100000:3.0:1788581180.415731:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076416 00000100:00100000:3.0:1788581180.415757:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581180.415764:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076416:12345-0@lo:503: 00000100:00100000:3.0:1788581180.415839:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076416:12345-0@lo:503: Request processed in 74us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.415845:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581180.415967:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581180.415983:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076416:0@lo:503: 00000040:00080000:1.0:1788581180.416210:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581180.416382:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076544:0@lo:502: 00000100:00100000:1.0:1788581180.416419:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.416484:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.416515:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076544 00000100:00100000:3.0:1788581180.416520:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076544 00000100:00100000:3.0:1788581180.416573:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581180.416581:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076544:12345-0@lo:502: 00000100:00100000:3.0:1788581180.416758:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076544:12345-0@lo:502: Request processed in 178us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.416766:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581180.416830:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076544:0@lo:502: 00000040:00080000:1.0:1788581180.416996:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788581180.417017:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788581180.417033:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076672:0@lo:502: 00000100:00100000:1.0:1788581180.417064:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.417117:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.417149:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076672 00000100:00100000:3.0:1788581180.417153:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076672 00000100:00100000:3.0:1788581180.417191:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788581180.417197:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076672:12345-0@lo:502: 00000100:00100000:3.0:1788581180.417341:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076672:12345-0@lo:502: Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.417348:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581180.417492:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076672:0@lo:502: 00000040:00080000:1.0:1788581180.417531:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788581180.417539:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788581180.417999:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581180.418008:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581180.418010:0:8428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788581180.418016:0:8428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6f8e1800 00000020:00000080:3.0:1788581180.418019:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581180.418030:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581180.418032:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581180.418038:0:8428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788581180.418041:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788581180.418176:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788581180.418197:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581180.418243:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.418296:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581180.418344:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581180.418352:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e6f8e1800 10000000:01000000:1.0:1788581180.418355:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e6f8e1800 10000000:01000000:1.0:1788581180.418359:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581180.418364:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6f8e1800 from 1 10000000:01000000:1.0:1788581180.418366:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581180.418392:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.418399:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.418409:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.418425:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076800:0@lo:101: 00000100:00100000:1.0:1788581180.418467:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.418495:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.418671:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076800 00000100:00100000:3.0:1788581180.418679:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076800 00000100:00100000:3.0:1788581180.418726:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788581180.418735:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8399:x1875463184076800:12345-0@lo:101: 00010000:00010000:3.0:1788581180.418747:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581180.418759:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f917 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.418780:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.418791:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.418800:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5600, rc 0) 00000100:00100000:3.0:1788581180.418842:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184076800:12345-0@lo:101: Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.418849:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581180.418949:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076800:0@lo:101: 00010000:00010000:1.0:1788581180.418963:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.418972:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.419039:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076928:0@lo:501: 00000100:00100000:1.0:1788581180.419075:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.419098:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.419133:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184076928 00000100:00100000:3.0:1788581180.419138:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184076928 00000100:00100000:3.0:1788581180.419209:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788581180.419217:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184076928:12345-0@lo:501: 00000100:00100000:3.0:1788581180.419330:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184076928:12345-0@lo:501: Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.419336:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788581180.419401:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184076928:0@lo:501: 00000100:00100000:1.0:1788581180.419425:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077056:0@lo:503: 00000100:00100000:1.0:1788581180.419466:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.419690:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581180.419749:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077056 00000100:00100000:0.0:1788581180.419754:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077056 00000100:00100000:0.0:1788581180.419775:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581180.419781:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077056:12345-0@lo:503: 00000100:00100000:0.0:1788581180.419868:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077056:12345-0@lo:503: Request processed in 86us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.419875:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581180.419966:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077056:0@lo:503: 00000040:00080000:1.0:1788581180.420184:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581180.420245:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077184:0@lo:502: 00000100:00100000:1.0:1788581180.420567:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.420656:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581180.420710:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077184 00000100:00100000:0.0:1788581180.420716:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077184 00000100:00100000:0.0:1788581180.420739:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581180.420746:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077184:12345-0@lo:502: 00000100:00100000:0.0:1788581180.420841:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077184:12345-0@lo:502: Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.420849:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581180.420928:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077184:0@lo:502: 00000040:00080000:1.0:1788581180.421110:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788581180.421136:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788581180.421152:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788581180.421179:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788581180.421416:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788581180.421437:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788581180.421454:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788581180.421482:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788581180.421498:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788581180.421513:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788581180.421528:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788581180.421541:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788581180.421553:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788581180.421567:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788581180.421580:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788581180.421670:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788581180.421688:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788581180.421701:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788581180.421714:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788581180.421726:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788581180.421738:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788581180.421750:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788581180.421774:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788581180.421801:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788581180.421817:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788581180.421829:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788581180.421842:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788581180.421855:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788581180.421867:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788581180.421879:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788581180.421892:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788581180.421908:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788581180.421920:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788581180.421930:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788581180.421942:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788581180.421954:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788581180.421967:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788581180.422002:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077312:0@lo:502: 00000100:00100000:1.0:1788581180.422056:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.422084:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581180.422209:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077312 00000100:00100000:3.0:1788581180.422215:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077312 00000100:00100000:3.0:1788581180.422276:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788581180.422284:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077312:12345-0@lo:502: 00000100:00100000:3.0:1788581180.422379:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184077312:12345-0@lo:502: Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.422386:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788581180.422532:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184077312:0@lo:502: 00000040:00080000:1.0:1788581180.422576:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788581180.422584:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788581180.423055:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788581180.423071:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff995d41c04d28) 00000020:00000080:1.0:1788581180.423092:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788581180.423181:0:8429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f8e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581180.423186:0:8429:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f8e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581180.423188:0:8429:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f8e1800 3 00010000:00080000:1.0:1788581180.423213:0:8429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7a6d6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581180.425483:0:8429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788581180.425789:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788581180.425838:0:8429:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581180.425853:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x50f0cc74b7b2f92c 00000100:00080000:1.0:1788581180.425862:0:8429:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581180.425868:0:8429:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a6d6000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581180.425904:0:8429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e477b4380 x1875463184077440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581180.425935:0:8429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788581180.426094:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788581180.426109:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff995d41c00000) 00000020:00000080:1.0:1788581180.426122:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788581180.426192:0:8429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f8e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581180.426196:0:8429:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f8e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581180.426199:0:8429:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f8e1800 3 00010000:00080000:1.0:1788581180.426228:0:8429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7a6d0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00000100:00100000:2.0:1788581180.426766:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184077568:0@lo:400: 00000100:00100000:2.0:1788581180.426830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.426869:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581180.426875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184077696:0@lo:400: 00000100:00100000:2.0:1788581180.426901:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.426933:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184077824:0@lo:400: 00000100:00100000:2.0:1788581180.426955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.426973:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581180.426978:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184077952:0@lo:400: 00000100:00100000:2.0:1788581180.426996:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581180.427028:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077568 00000100:00100000:2.0:1788581180.427034:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077568 00000100:00100000:2.0:1788581180.427068:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077824 00000100:00100000:2.0:1788581180.427071:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077824 00000100:00100000:2.0:1788581180.427085:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581180.427092:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184077568:12345-0@lo:400: 00000100:00100000:2.0:1788581180.427140:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184077568:12345-0@lo:400: Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.427146:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581180.427175:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581180.427182:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184077824:12345-0@lo:400: 00000100:00100000:2.0:1788581180.427211:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184077824:12345-0@lo:400: Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.427217:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581180.427234:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077696 00000100:00100000:2.0:1788581180.427238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077696 00000100:00100000:2.0:1788581180.427276:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077952 00000100:00100000:2.0:1788581180.427279:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077952 00000100:00100000:2.0:1788581180.427302:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581180.427307:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184077696:12345-0@lo:400: 00000100:00100000:2.0:1788581180.427337:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184077696:12345-0@lo:400: Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.427342:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581180.427352:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581180.427357:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184077952:12345-0@lo:400: 00000100:00100000:2.0:1788581180.427381:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184077952:12345-0@lo:400: Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.427387:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581180.427425:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184077696:0@lo:400: 00010000:00080000:2.0:1788581180.427437:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e6facc700 x1875463184077568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581180.427447:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184077568:0@lo:400: 00000100:00100000:2.0:1788581180.427475:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184077952:0@lo:400: 00010000:00080000:2.0:1788581180.427483:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e6facf100 x1875463184077824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581180.427491:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184077824:0@lo:400: 00000100:00100000:3.0:1788581180.427698:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184077440:0@lo:38: 00000100:00100000:3.0:1788581180.427733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.429961:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184077440 00000100:00100000:3.0:1788581180.429976:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184077440 00000100:00100000:3.0:1788581180.430028:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581180.430037:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184077440:12345-0@lo:38: 00010000:00080000:3.0:1788581180.430063:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1788581180.430100:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x50f0cc74b7b2f93a 00000004:00100000:3.0:1788581180.430116:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581180.430149:0:6493:0:(import.c:65:import_set_state_nolock()) ffff995e6f0da000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581180.430237:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875463184077440:12345-0@lo:38: Request processed in 199us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.430244:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788581180.430306:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e477b4380 x1875463184077440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581180.430317:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581180.430324:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788581180.430333:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788581180.430338:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788581180.430341:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788581180.430346:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184077440:0@lo:38: 00010000:00010000:1.0:1788581180.433540:0:8429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788581180.433832:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788581180.433873:0:8429:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581180.433885:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x50f0cc74b7b2f941 00000100:00080000:1.0:1788581180.433894:0:8429:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581180.433899:0:8429:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff995e7a6d0800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581180.433927:0:8429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e477b7b80 x1875463184078080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581180.433961:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184078080:0@lo:38: 00000100:00100000:1.0:1788581180.434028:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581180.434089:0:8429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788581180.434306:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788581180.434522:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788581180.434551:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581180.434566:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.434576:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788581180.434698:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788581180.434700:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788581180.434701:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581180.434702:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581180.434704:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581180.434705:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581180.434706:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581180.434708:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581180.434709:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581180.434710:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581180.434711:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581180.434716:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788581180.434718:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581180.434719:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788581180.434720:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581180.434721:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581180.434722:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581180.434723:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581180.434724:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581180.434725:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581180.434726:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581180.434727:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581180.434728:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581180.434746:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788581180.434758:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184078208:0@lo:253: 00000100:00100000:3.0:1788581180.434799:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.434830:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581180.435717:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078208 00000100:00100000:1.0:1788581180.435726:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078208 00000100:00100000:1.0:1788581180.435774:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581180.435783:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184078208:12345-0@lo:253: 20000000:01000000:1.0:1788581180.435810:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581180.435823:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788581180.435981:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078080 00000100:00100000:0.0:1788581180.435985:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078080 00000100:00100000:0.0:1788581180.436013:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581180.436025:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184078080:12345-0@lo:38: 00010000:00080000:0.0:1788581180.436044:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1788581180.436077:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x50f0cc74b7b2f948 00000004:00100000:0.0:1788581180.436091:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581180.436122:0:6495:0:(import.c:65:import_set_state_nolock()) ffff995e7a780800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581180.436199:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875463184078080:12345-0@lo:38: Request processed in 174us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.436206:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788581180.436306:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e477b7b80 x1875463184078080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581180.436316:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581180.436323:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788581180.436330:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581180.436334:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788581180.436336:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581180.436341:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184078080:0@lo:38: 20000000:01000000:3.0:1788581180.448670:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788581180.448697:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788581180.448844:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581180.448849:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581180.448869:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.448888:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.448897:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.448904:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.448941:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.448955:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581180.448968:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a643480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184078336:0@lo:104: 00000100:00100000:0.0:1788581180.449033:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581180.449184:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:8399:x1875463184078208:12345-0@lo:253: Request processed in 13401us (14383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.449195:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:0.0:1788581180.449372:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.449381:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 15 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581180.449390:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184078464:0@lo:104: 00000100:00100000:0.0:1788581180.449411:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581180.449488:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8399:1875463184078208:0@lo:253: 10000000:01000000:2.0:1788581180.449500:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788581180.449502:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581180.449504:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788581180.449506:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581180.449507:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581180.449508:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581180.449516:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581180.449518:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581180.449519:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581180.449521:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581180.449523:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581180.449524:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788581180.449540:0:8399:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788581180.453439:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788581180.453480:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.453560:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078336 00000100:00100000:1.0:1788581180.453568:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078336 00080000:10000000:2.0:1788581180.453871:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788581180.454034:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788581180.454227:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:0.0:1788581180.454366:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078464 00000100:00100000:0.0:1788581180.454371:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078464 00000100:00100000:0.0:1788581180.454395:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581180.454404:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e81f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184078336:12345-0@lo:104: 00010000:00010000:0.0:1788581180.454421:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.454497:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581180.454503:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e81f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184078336:12345-0@lo:104: Request processed in 101us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.454510:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581180.454543:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581180.454549:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184078464:12345-0@lo:104: 00010000:00010000:0.0:1788581180.454556:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581180.454582:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788581180.454665:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581180.454672:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454680:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581180.454684:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454693:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581180.454701:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.454707:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581180.454740:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454746:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581180.454765:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454772:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2f85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f861 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454783:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581180.454786:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454798:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ec00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581180.454801:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454807:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581180.454813:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581180.454818:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581180.454829:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454834:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581180.454839:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454845:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f845 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.454857:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.454859:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.454860:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581180.454866:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581180.454892:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184078464:12345-0@lo:104: Request processed in 38us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.454900:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581180.455085:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a643480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184078336:0@lo:104: 00000100:00100000:0.0:1788581180.455101:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184078464:0@lo:104: 00010000:00010000:0.0:1788581180.455120:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581180.455193:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184078592:0@lo:103: 00000100:00100000:2.0:1788581180.455234:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581180.455327:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184078720:0@lo:103: 00000100:00100000:3.0:1788581180.455430:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078592 00000100:00100000:3.0:1788581180.455435:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078592 00010000:00010000:3.0:1788581180.455456:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581180.455486:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581180.455492:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184078592:12345-0@lo:103: 00010000:00010000:3.0:1788581180.455502:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581180.455507:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.455516:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.455530:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a200/0x50f0cc74b7b2f861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f85a expref: 16 pid: 6488 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581180.455543:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581180.455565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.455690:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078720 00000100:00100000:1.0:1788581180.455694:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078720 00010000:00010000:1.0:1788581180.455708:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581180.455724:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581180.455729:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3619:x1875463184078720:12345-0@lo:103: 00010000:00010000:1.0:1788581180.455735:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581180.455739:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455795:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455811:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c3e00/0x50f0cc74b7b2f845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f83e expref: 16 pid: 6486 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455821:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455829:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581180.455843:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006994419s 00010000:00010000:1.0:1788581180.455847:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455855:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455861:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455868:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455874:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40030400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581180.455878:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455885:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455898:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455918:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581180.455948:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:3619:x1875463184078720:12345-0@lo:103: Request processed in 219us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.455955:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788581180.455978:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455984:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581180.455991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2f94f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788581180.456361:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788581180.456619:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788581180.456851:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788581180.458054:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788581180.459387:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184078720:0@lo:103: 00000100:00100000:3.0:1788581180.462440:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3618:x1875463184078592:12345-0@lo:103: Request processed in 6939us (7196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.462454:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581180.465125:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184078592:0@lo:103: 00002000:00080000:0.0:1788581180.466206:0:8399:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788581180.466214:0:8399:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788581180.466419:0:8399:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788581180.466470:0:8399:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788581180.466499:0:8399:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788581180.466528:0:8399:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788581180.467420:0:8399:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581180.467651:0:8399:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788581181.130328:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581181.248951:0:8485:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581181.249166:0:8485:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581182.151597:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581182.273497:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581182.273524:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184078848:0@lo:41: 00000100:00100000:3.0:1788581182.273963:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581182.274121:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078848 00000100:00100000:2.0:1788581182.274129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078848 00000100:00100000:2.0:1788581182.274187:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581182.274196:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184078848:12345-0@lo:41: 00000004:00000024:2.0:1788581182.274230:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788581182.274328:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184078848:12345-0@lo:41: Request processed in 133us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581182.274351:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581182.274434:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184078848:0@lo:41: 00010000:00010000:3.0:1788581183.172002:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581184.200191:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581184.847537:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581184.847561:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184078976:0@lo:41: 00000100:00100000:0.0:1788581184.847644:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581184.847709:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184078976 00000100:00100000:0.0:1788581184.847716:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184078976 00000100:00100000:0.0:1788581184.847760:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581184.847769:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184078976:12345-0@lo:41: 00000004:00000024:0.0:1788581184.847802:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788581184.847851:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184078976:12345-0@lo:41: Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581184.847869:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581184.847918:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184078976:0@lo:41: 00010000:00010000:1.0:1788581185.217695:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581185.859280:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184079232:0@lo:400: 00000100:00100000:2.0:1788581185.859361:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184079104:0@lo:400: 00000100:00100000:2.0:1788581185.863403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581185.863467:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184079616:0@lo:400: 00000100:00100000:2.0:1788581185.863806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581185.863859:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079104 00000100:00100000:2.0:1788581185.863873:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079104 00000100:00100000:2.0:1788581185.863917:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788581185.863926:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3618:x1875463184079104:12345-0@lo:400: 00000100:00100000:2.0:1788581185.863976:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:3618:x1875463184079104:12345-0@lo:400: Request processed in 51us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581185.863983:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788581185.864013:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079616 00000100:00100000:2.0:1788581185.864016:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079616 00000100:00100000:2.0:1788581185.864382:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581185.864390:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184079616:12345-0@lo:400: 00000100:00100000:2.0:1788581185.864428:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184079616:12345-0@lo:400: Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581185.864434:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581185.864470:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184079104:0@lo:400: 00000100:00100000:2.0:1788581185.864481:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184079616:0@lo:400: 00000100:00100000:0.0:1788581185.864798:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184079360:0@lo:400: 00000100:00100000:0.0:1788581185.864831:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581185.864852:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184079872:0@lo:400: 00000100:00100000:0.0:1788581185.864878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581185.864897:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581185.864903:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184079488:0@lo:400: 00000100:00100000:0.0:1788581185.864924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581185.864948:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079360 00000100:00100000:0.0:1788581185.864951:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079360 00000100:00100000:0.0:1788581185.864976:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581185.864982:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184079360:12345-0@lo:400: 00000100:00100000:0.0:1788581185.865017:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184079360:12345-0@lo:400: Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.865121:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581185.865148:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079872 00000100:00100000:0.0:1788581185.865152:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079872 00000100:00100000:0.0:1788581185.865218:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079488 00000100:00100000:0.0:1788581185.865221:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079488 00000100:00100000:0.0:1788581185.865232:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581185.865238:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184079872:12345-0@lo:400: 00000100:00100000:0.0:1788581185.865293:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184079872:12345-0@lo:400: Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.865299:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581185.865309:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581185.865321:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184079488:12345-0@lo:400: 00000100:00100000:0.0:1788581185.865347:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184079488:12345-0@lo:400: Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.865352:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788581185.865380:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42259500 x1875463184079488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581185.865392:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184079488:0@lo:400: 00000100:00100000:0.0:1788581185.865400:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184079360:0@lo:400: 00010000:00080000:0.0:1788581185.865407:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4225a300 x1875463184079872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581185.865415:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184079872:0@lo:400: 00000100:00080000:2.0:1788581185.865638:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581185.865943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581185.866034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184079744:0@lo:400: 00000100:00100000:1.0:1788581185.866062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581185.866234:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079232 00000100:00100000:0.0:1788581185.866240:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079232 00000100:00100000:0.0:1788581185.866291:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184079744 00000100:00100000:0.0:1788581185.866295:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184079744 00000100:00100000:0.0:1788581185.866318:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581185.866323:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184079232:12345-0@lo:400: 00000100:00100000:0.0:1788581185.866362:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184079232:12345-0@lo:400: Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.866368:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581185.866380:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581185.866385:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184079744:12345-0@lo:400: 00000100:00100000:0.0:1788581185.866409:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184079744:12345-0@lo:400: Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.866415:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788581185.866458:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e477b6680 x1875463184079232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581185.866469:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184079232:0@lo:400: 00010000:00080000:0.0:1788581185.866482:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42259f80 x1875463184079744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581185.866490:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184079744:0@lo:400: 00000100:00080000:2.0:1788581185.866828:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581186.242613:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581186.417590:0:8775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788581187.270947:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788581187.312039:0:8827:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581187.312673:0:8827:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788581187.393750:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184080000:0@lo:41: 00000100:00100000:3.0:1788581187.393820:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581187.394904:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080000 00000100:00100000:2.0:1788581187.394914:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080000 00000100:00100000:2.0:1788581187.394973:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788581187.394984:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184080000:12345-0@lo:41: 00000004:00000024:2.0:1788581187.395018:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788581187.395080:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184080000:12345-0@lo:41: Request processed in 97us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581187.395088:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581187.396837:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184080000:0@lo:41: 00010000:00010000:0.0:1788581188.291557:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581189.313431:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788581189.441354:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581189.441362:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4f1e6000 from 30 10000000:01000000:3.0:1788581189.441369:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581189.441411:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.441423:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.441436:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.441459:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080128:0@lo:101: 00000100:00100000:3.0:1788581189.441542:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.441587:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.444686:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080128 00000100:00100000:2.0:1788581189.444700:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080128 00000100:00100000:2.0:1788581189.444759:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788581189.444770:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:6490:x1875463184080128:12345-0@lo:101: 00010000:00010000:2.0:1788581189.444786:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581189.444803:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f956 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.444828:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.444838:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.444847:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e000, rc 0) 00000100:00100000:2.0:1788581189.444919:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080128:12345-0@lo:101: Request processed in 151us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.444926:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788581189.445382:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080128:0@lo:101: 00010000:00010000:3.0:1788581189.445402:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.445413:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.445487:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080256:0@lo:501: 00000100:00100000:3.0:1788581189.445520:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.445557:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.445610:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080256 00000100:00100000:2.0:1788581189.445616:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080256 00000100:00100000:2.0:1788581189.445650:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788581189.445666:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080256:12345-0@lo:501: 00000100:00100000:2.0:1788581189.445785:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080256:12345-0@lo:501: Request processed in 119us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.445792:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788581189.446135:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080256:0@lo:501: 00000100:00100000:0.0:1788581189.446168:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080384:0@lo:503: 00000100:00100000:0.0:1788581189.446215:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.446244:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.446317:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080384 00000100:00100000:2.0:1788581189.446322:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080384 00000100:00100000:3.0:1788581189.446376:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788581189.446390:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080384:12345-0@lo:503: 00000100:00100000:3.0:1788581189.446482:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080384:12345-0@lo:503: Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.446497:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788581189.446503:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080384:0@lo:503: 00000100:00100000:0.0:1788581189.447009:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8898:1875463184080512:0@lo:502: 00000100:00100000:0.0:1788581189.447049:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.447126:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.447160:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080512 00000100:00100000:3.0:1788581189.447165:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080512 00000100:00100000:3.0:1788581189.447200:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581189.447208:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8898:x1875463184080512:12345-0@lo:502: 00000100:00100000:3.0:1788581189.447388:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8898:x1875463184080512:12345-0@lo:502: Request processed in 180us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.447396:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581189.447459:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8898:1875463184080512:0@lo:502: 00000100:00100000:0.0:1788581189.447503:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8898:1875463184080640:0@lo:502: 00000100:00100000:0.0:1788581189.448227:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.448345:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.448380:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080640 00000100:00100000:3.0:1788581189.448386:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080640 00000100:00100000:3.0:1788581189.448465:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581189.448476:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8898:x1875463184080640:12345-0@lo:502: 00000100:00100000:3.0:1788581189.448593:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:8898:x1875463184080640:12345-0@lo:502: Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.448600:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581189.448662:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8898:1875463184080640:0@lo:502: 00000040:00080000:0.0:1788581189.448686:0:8898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788581189.449077:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788581189.449114:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581189.449124:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.449135:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581189.449143:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581189.449146:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4f1e6000 from 5 10000000:01000000:3.0:1788581189.449149:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581189.449181:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.449200:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.449208:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.449224:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080768:0@lo:101: 00000100:00100000:3.0:1788581189.449408:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.449465:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.449498:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080768 00000100:00100000:0.0:1788581189.449503:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080768 00000100:00100000:0.0:1788581189.449701:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581189.449709:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184080768:12345-0@lo:101: 00010000:00010000:0.0:1788581189.449720:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581189.449733:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f964 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.449752:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.449762:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.449771:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40031600, rc 0) 00000100:00100000:0.0:1788581189.449842:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184080768:12345-0@lo:101: Request processed in 134us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.449849:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581189.449966:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080768:0@lo:101: 00010000:00010000:3.0:1788581189.449980:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.449989:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.450036:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080896:0@lo:256: 00000100:00100000:3.0:1788581189.450066:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.450127:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.450155:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184080896 00000100:00100000:0.0:1788581189.450159:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184080896 00000100:00100000:0.0:1788581189.450215:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581189.450223:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184080896:12345-0@lo:256: 20000000:01000000:0.0:1788581189.450236:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581189.450272:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581189.450277:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788581189.450358:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184080896:12345-0@lo:256: Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.450365:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581189.450759:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184080896:0@lo:256: 10000000:01000000:0.0:1788581189.450810:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581189.450821:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.450829:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581189.450837:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788581189.450839:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788581189.450842:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581189.450862:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.450869:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.450877:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581189.454314:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081024:0@lo:101: 00000100:00100000:0.0:1788581189.454381:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.454416:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.455344:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081024 00000100:00100000:2.0:1788581189.455353:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081024 00000100:00100000:2.0:1788581189.455409:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788581189.455417:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184081024:12345-0@lo:101: 00010000:00010000:2.0:1788581189.455432:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581189.455448:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f972 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.455472:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.455482:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.455491:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f000, rc 0) 00000100:00100000:2.0:1788581189.455548:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184081024:12345-0@lo:101: Request processed in 132us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.455554:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581189.455809:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081024:0@lo:101: 00010000:00010000:0.0:1788581189.455827:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.455836:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581189.455918:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081152:0@lo:501: 00000100:00100000:0.0:1788581189.455956:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.455986:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.456419:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081152 00000100:00100000:1.0:1788581189.456426:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081152 00000100:00100000:1.0:1788581189.456466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788581189.456475:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184081152:12345-0@lo:501: 00000100:00100000:1.0:1788581189.456617:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184081152:12345-0@lo:501: Request processed in 143us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.456632:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581189.456685:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081152:0@lo:501: 00000100:00100000:0.0:1788581189.456712:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081280:0@lo:503: 00000100:00100000:0.0:1788581189.456751:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.456775:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.456811:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081280 00000100:00100000:2.0:1788581189.456815:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081280 00000100:00100000:2.0:1788581189.456841:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788581189.456850:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184081280:12345-0@lo:503: 00000100:00100000:2.0:1788581189.456948:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184081280:12345-0@lo:503: Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.456955:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788581189.456984:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184081280:0@lo:503: 00000100:00100000:0.0:1788581189.457708:0:8899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8899:1875463184081408:0@lo:502: 00000100:00100000:0.0:1788581189.457749:0:8899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.457774:0:8899:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.458018:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081408 00000100:00100000:1.0:1788581189.458024:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081408 00000100:00100000:1.0:1788581189.458135:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581189.458144:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8899:x1875463184081408:12345-0@lo:502: 00000100:00100000:1.0:1788581189.458248:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8899:x1875463184081408:12345-0@lo:502: Request processed in 105us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.458294:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788581189.460228:0:8899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8899:1875463184081408:0@lo:502: 00000020:01000000:2.0:1788581189.460288:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788581189.460295:0:8899:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788581189.460305:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581189.460307:0:8899:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788581189.460319:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581189.460323:0:8899:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1788581189.460345:0:8899:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788581189.460348:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581189.460374:0:8899:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff995e7a7399b8) 00000020:00000080:2.0:1788581189.460396:0:8899:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788581189.460402:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581189.460485:0:8899:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788581189.460492:0:8899:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788581189.460508:0:8899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2f987 00010000:00080000:2.0:1788581189.460597:0:8899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4f27e800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581189.460831:0:8899:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788581189.472395:0:8899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788581189.472419:0:8899:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788581189.472759:0:8899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581189.473035:0:8899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581189.473131:0:8899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788581189.473232:0:8899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788581189.473789:0:8900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581189.473795:0:8900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788581189.476221:0:8899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788581189.476245:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788581189.476335:0:8899:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788581189.476361:0:8899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2f98e 00000100:00080000:3.0:1788581189.476372:0:8899:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581189.476551:0:8899:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e4f27e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581189.476656:0:8899:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e71eaaa00 x1875463184081536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581189.476681:0:8899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788581189.476872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184081536:0@lo:8: 00000100:00100000:0.0:1788581189.476949:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184081664:0@lo:400: 00000100:00100000:0.0:1788581189.477005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477033:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184082176:0@lo:400: 00000100:00100000:0.0:1788581189.477050:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477066:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788581189.477071:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184081792:0@lo:400: 00000100:00100000:0.0:1788581189.477118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477134:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184082304:0@lo:400: 00000100:00100000:0.0:1788581189.477151:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477174:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184082048:0@lo:400: 00000100:00100000:0.0:1788581189.477192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477208:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581189.477216:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184081920:0@lo:400: 00000100:00100000:0.0:1788581189.477233:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.477268:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081664 00000100:00100000:0.0:1788581189.477274:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081664 00000100:00100000:0.0:1788581189.477315:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082176 00000100:00100000:0.0:1788581189.477318:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082176 00000100:00100000:0.0:1788581189.477349:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082304 00000100:00100000:0.0:1788581189.477352:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082304 00000100:00100000:0.0:1788581189.477361:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081920 00000100:00100000:0.0:1788581189.477363:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081920 00000100:00100000:0.0:1788581189.477374:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581189.477381:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184081664:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477433:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184081664:12345-0@lo:400: Request processed in 52us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477440:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581189.477452:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581189.477457:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184082176:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477479:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184082176:12345-0@lo:400: Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477484:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581189.477492:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581189.477497:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184082304:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477515:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184082304:12345-0@lo:400: Request processed in 18us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477521:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581189.477528:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581189.477533:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184081920:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477554:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184081920:12345-0@lo:400: Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477560:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581189.477576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081792 00000100:00100000:0.0:1788581189.477584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081792 00000100:00100000:0.0:1788581189.477604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082048 00000100:00100000:0.0:1788581189.477606:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082048 00000100:00100000:0.0:1788581189.477615:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581189.477620:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184081792:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477655:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184081792:12345-0@lo:400: Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477661:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581189.477670:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581189.477676:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184082048:12345-0@lo:400: 00000100:00100000:0.0:1788581189.477694:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184082048:12345-0@lo:400: Request processed in 19us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.477700:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788581189.477728:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581189.477731:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788581189.477753:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a0e00 x1875463184081920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.477766:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184081920:0@lo:400: 00000100:00100000:0.0:1788581189.477775:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184082048:0@lo:400: 00000100:00100000:0.0:1788581189.477798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184081792:0@lo:400: 00010000:00080000:0.0:1788581189.477806:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a3480 x1875463184082304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.477814:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184082304:0@lo:400: 00010000:00080000:0.0:1788581189.477822:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7a640e00 x1875463184081664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.477841:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184081664:0@lo:400: 00010000:00080000:0.0:1788581189.477850:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a3800 x1875463184082176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.477858:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184082176:0@lo:400: 00000100:00100000:1.0:1788581189.478088:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.478401:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184081536 00000100:00100000:2.0:1788581189.478407:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184081536 00000100:00100000:2.0:1788581189.478441:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581189.478447:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184081536:12345-0@lo:8: 00010000:00080000:2.0:1788581189.478471:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1788581189.478498:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2f995 00002000:00100000:2.0:1788581189.478535:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff995e4f27a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788581189.478539:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788581189.478542:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788581189.478600:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581189.478826:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788581189.478847:0:8408:0:(import.c:65:import_set_state_nolock()) ffff995e4f27b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581189.478903:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184081536:12345-0@lo:8: Request processed in 454us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.478909:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1788581189.479349:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581189.479356:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581189.479358:0:8899:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788581189.479361:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581189.479365:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581189.479367:0:8899:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581189.479370:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581189.479371:0:8899:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788581189.479408:0:8899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8899:1875463184082432:0@lo:502: 00000100:00100000:3.0:1788581189.479457:0:8899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.479487:0:8899:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0540 going to sleep for 11 seconds 00010000:00080000:1.0:1788581189.479804:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71eaaa00 x1875463184081536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581189.479816:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581189.479823:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788581189.479830:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581189.479835:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788581189.479837:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581189.479890:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581189.479896:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184081536:0@lo:8: 00000100:00100000:0.0:1788581189.479934:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082432 00000100:00100000:0.0:1788581189.479939:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082432 00000100:00100000:2.0:1788581189.479969:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184082560:0@lo:700: 00000100:00100000:0.0:1788581189.479980:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788581189.479988:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8899:x1875463184082432:12345-0@lo:502: 00000100:00100000:2.0:1788581189.480007:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.480031:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639d80 going to sleep for 11 seconds 00000004:00080000:3.0:1788581189.480071:0:8900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788581189.480120:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:8899:x1875463184082432:12345-0@lo:502: Request processed in 133us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.480127:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788581189.480144:0:8899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8899:1875463184082432:0@lo:502: 00000020:01000000:2.0:1788581189.480163:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581189.480168:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581189.480169:0:8899:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581189.480173:0:8899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1788581189.480304:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788581189.480326:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788581189.480336:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.480345:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581189.480362:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788581189.480364:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3a800 from 30 10000000:01000000:1.0:1788581189.480367:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581189.480391:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.480398:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.480406:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581189.480418:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184082688:0@lo:101: 00000100:00100000:1.0:1788581189.480446:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.480468:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.480602:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082560 00000100:00100000:3.0:1788581189.480607:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082560 00000100:00100000:0.0:1788581189.480628:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082688 00000100:00100000:0.0:1788581189.480632:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082688 00000100:00100000:3.0:1788581189.480687:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581189.480697:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8901:x1875463184082560:12345-0@lo:700: 00000100:00100000:0.0:1788581189.480704:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788581189.480712:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184082688:12345-0@lo:101: 00010000:00010000:0.0:1788581189.480720:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581189.480732:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f99c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.480734:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8416:1875463184082816:0@lo:700: 00010000:00010000:0.0:1788581189.480752:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581189.480760:0:8416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581189.480763:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.480771:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40031a00, rc 0) 00000100:00100000:3.0:1788581189.480783:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.480806:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184082688:12345-0@lo:101: Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.480811:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:3.0:1788581189.480852:0:8900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 175622597008ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788581189.480859:0:8900:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788581189.480864:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082816 00000100:00100000:2.0:1788581189.480868:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082816 00000100:00100000:2.0:1788581189.480902:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581189.480909:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8416:x1875463184082816:12345-0@lo:700: 00000100:00080000:1.0:1788581189.480976:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581189.481000:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184082688:0@lo:101: 00010000:00010000:1.0:1788581189.481013:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.481021:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581189.481070:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184082944:0@lo:501: 00000100:00100000:1.0:1788581189.481230:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.481319:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.481528:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184082944 00000100:00100000:2.0:1788581189.481533:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184082944 00000100:00100000:2.0:1788581189.481568:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581189.481575:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184082944:12345-0@lo:501: 00000100:00100000:2.0:1788581189.481674:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184082944:12345-0@lo:501: Request processed in 99us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.481680:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581189.482805:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184082944:0@lo:501: 00000100:00100000:1.0:1788581189.482862:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083072:0@lo:503: 00000100:00100000:1.0:1788581189.482930:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.482967:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.483151:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083072 00000100:00100000:0.0:1788581189.483158:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083072 00000100:00100000:0.0:1788581189.483204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581189.483212:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184083072:12345-0@lo:503: 00000100:00100000:0.0:1788581189.483330:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184083072:12345-0@lo:503: Request processed in 118us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.483343:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581189.483395:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083072:0@lo:503: 00000004:00080000:3.0:1788581189.483784:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788581189.484748:0:8902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8902:1875463184083200:0@lo:502: 00000100:00100000:3.0:1788581189.484809:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.484843:0:8902:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.485154:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083200 00000100:00100000:0.0:1788581189.485161:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083200 00000100:00100000:0.0:1788581189.485207:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581189.485217:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8902:x1875463184083200:12345-0@lo:502: 00000100:00100000:0.0:1788581189.485358:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8902:x1875463184083200:12345-0@lo:502: Request processed in 141us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.485365:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581189.485537:0:8902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8902:1875463184083200:0@lo:502: 00000100:00100000:3.0:1788581189.485581:0:8902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8902:1875463184083328:0@lo:502: 00000100:00100000:3.0:1788581189.485612:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.485673:0:8902:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.486088:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083328 00000100:00100000:1.0:1788581189.486094:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083328 00000100:00100000:1.0:1788581189.486169:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788581189.486177:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8902:x1875463184083328:12345-0@lo:502: 00000100:00100000:1.0:1788581189.486297:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:8902:x1875463184083328:12345-0@lo:502: Request processed in 121us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.486304:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788581189.486387:0:8902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8902:1875463184083328:0@lo:502: 00000040:00080000:3.0:1788581189.486410:0:8902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788581189.486633:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788581189.486655:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581189.486666:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.486677:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581189.486686:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581189.486689:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3a800 from 5 10000000:01000000:2.0:1788581189.486698:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581189.486725:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.486732:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.486741:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581189.486756:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083456:0@lo:101: 00000100:00100000:2.0:1788581189.486789:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.487280:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.487534:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083456 00000100:00100000:0.0:1788581189.487542:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083456 00000100:00100000:0.0:1788581189.487576:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788581189.487583:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184083456:12345-0@lo:101: 00010000:00010000:0.0:1788581189.487594:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581189.487606:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f9aa expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.487634:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.487657:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581189.487666:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40030600, rc 0) 00000100:00100000:0.0:1788581189.487715:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184083456:12345-0@lo:101: Request processed in 132us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.487721:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788581189.487880:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083456:0@lo:101: 00010000:00010000:2.0:1788581189.487894:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.487904:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581189.487955:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083584:0@lo:256: 00000100:00100000:2.0:1788581189.487988:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.487996:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083584 00000100:00100000:1.0:1788581189.488000:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083584 00000100:00100000:2.0:1788581189.488006:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.488017:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788581189.488024:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184083584:12345-0@lo:256: 20000000:01000000:1.0:1788581189.488038:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581189.488058:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581189.488061:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788581189.488156:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184083584:12345-0@lo:256: Request processed in 132us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.488162:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788581189.488233:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083584:0@lo:256: 10000000:01000000:2.0:1788581189.488318:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581189.488324:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.488426:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581189.488467:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788581189.488469:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788581189.488473:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581189.488490:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.488497:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.488504:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581189.488516:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083712:0@lo:101: 00000100:00100000:2.0:1788581189.488541:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.488684:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 40000000:02000000:2.0:1788581189.488747:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1788581189.494043:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083712 00000100:00100000:3.0:1788581189.494058:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083712 00000100:00100000:3.0:1788581189.494155:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788581189.494167:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184083712:12345-0@lo:101: 00010000:00010000:3.0:1788581189.494187:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581189.494207:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f9b8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.494235:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.494246:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581189.494274:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5000, rc 0) 00000100:00100000:3.0:1788581189.494362:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184083712:12345-0@lo:101: Request processed in 198us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.494394:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788581189.495237:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8416:x1875463184082816:12345-0@lo:700: Request processed in 14327us (14473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.495247:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581189.495444:0:8416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71ea8000 x1875463184082816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581189.495459:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8416:1875463184082816:0@lo:700: 40000000:02000000:3.0:1788581189.495470:0:8416:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1788581189.495600:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083712:0@lo:101: 00010000:00010000:2.0:1788581189.495616:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.495626:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581189.495700:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083840:0@lo:501: 00000100:00100000:2.0:1788581189.495747:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.497081:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.499661:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083840 00000100:00100000:0.0:1788581189.499675:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083840 00000100:00100000:0.0:1788581189.499732:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788581189.499820:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184083840:12345-0@lo:501: 00000100:00100000:0.0:1788581189.501296:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184083840:12345-0@lo:501: Request processed in 1473us (5542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.501308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788581189.501356:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083840:0@lo:501: 00000100:00100000:2.0:1788581189.501414:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083968:0@lo:503: 00000100:00100000:2.0:1788581189.501470:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.501512:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.501676:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184083968 00000100:00100000:0.0:1788581189.501682:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184083968 00000100:00100000:0.0:1788581189.501723:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788581189.501732:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184083968:12345-0@lo:503: 00000100:00100000:0.0:1788581189.501818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184083968:12345-0@lo:503: Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.501824:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788581189.501864:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184083968:0@lo:503: 00000100:00100000:0.0:1788581189.502158:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8903:1875463184084096:0@lo:502: 00000100:00100000:0.0:1788581189.502193:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.502212:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084096 00000100:00100000:0.0:1788581189.502221:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084096 00000100:00100000:0.0:1788581189.502246:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788581189.502283:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:8903:x1875463184084096:12345-0@lo:502: 00000100:00100000:0.0:1788581189.503700:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:8903:x1875463184084096:12345-0@lo:502: Request processed in 1442us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.503711:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788581189.503771:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581189.503791:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8903:1875463184084096:0@lo:502: 00000020:01000000:0.0:1788581189.503819:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581189.503826:0:8903:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788581189.503832:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581189.503835:0:8903:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788581189.503839:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788581189.503843:0:8903:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1788581189.503864:0:8903:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788581189.503866:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581189.504979:0:8903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff995e7fa03370) 00000020:00000080:0.0:1788581189.505008:0:8903:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788581189.505019:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788581189.505126:0:8903:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788581189.505132:0:8903:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788581189.505140:0:8903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2f9cd 00010000:00080000:0.0:1788581189.505170:0:8903:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e6f941000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1788581189.505716:0:8903:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:1.0:1788581189.513183:0:8903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788581189.513206:0:8903:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581189.513439:0:8903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581189.513646:0:8903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581189.513729:0:8903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788581189.513816:0:8903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788581189.514749:0:8904:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581189.514755:0:8904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:2.0:1788581189.515162:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788581189.515332:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184082560:12345-0@lo:700: Request processed in 34633us (35320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.515343:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788581189.515489:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facc700 x1875463184082560/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581189.515505:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184082560:0@lo:700: 00000020:00000080:1.0:1788581189.516220:0:8903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581189.516232:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788581189.516617:0:8903:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788581189.516642:0:8903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2f9d4 00000100:00080000:1.0:1788581189.516651:0:8903:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581189.516657:0:8903:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e6f941000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581189.516687:0:8903:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d42258a80 x1875463184084224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581189.516739:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184084224:0@lo:8: 00000100:00100000:2.0:1788581189.516793:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581189.516852:0:8903:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788581189.516988:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084224 00000100:00100000:3.0:1788581189.516994:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084224 00000100:00100000:3.0:1788581189.517024:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581189.517032:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875463184084224:12345-0@lo:8: 00010000:00080000:3.0:1788581189.517055:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1788581189.517078:0:8410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2f9db 00002000:00100000:3.0:1788581189.517091:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff995e6f0db000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788581189.517095:0:8410:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788581189.517097:0:8410:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788581189.517174:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581189.517194:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e6f0df000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1788581189.517309:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581189.517315:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581189.517317:0:8903:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788581189.517321:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581189.517325:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581189.517327:0:8903:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581189.517330:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581189.517332:0:8903:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788581189.517355:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8903:1875463184084352:0@lo:502: 00000100:00100000:1.0:1788581189.517399:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.517419:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.518758:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184084224:12345-0@lo:8: Request processed in 1719us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.518770:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581189.518985:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258a80 x1875463184084224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581189.518997:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581189.519006:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788581189.519013:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788581189.519018:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788581189.519021:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f941000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788581189.519093:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788581189.519108:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184084224:0@lo:8: 00000100:00100000:2.0:1788581189.519142:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084352 00000100:00100000:2.0:1788581189.519149:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084352 00000100:00100000:2.0:1788581189.519199:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581189.519208:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:8903:x1875463184084352:12345-0@lo:502: 00000100:00100000:2.0:1788581189.519385:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:8903:x1875463184084352:12345-0@lo:502: Request processed in 178us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.519393:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788581189.519501:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:8903:1875463184084352:0@lo:502: 00000020:01000000:1.0:1788581189.519540:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581189.519547:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581189.519549:0:8903:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788581189.519569:0:8903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:1.0:1788581189.519703:0:8904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581189.519763:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 175661508725ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581189.519770:0:8904:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1788581189.519822:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788581189.519845:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581189.519855:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.519866:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581189.519876:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581189.519879:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7557cd28 from 1 10000000:01000000:2.0:1788581189.519882:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581189.519921:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.519929:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581189.519938:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581189.519954:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184084480:0@lo:101: 00000100:00100000:2.0:1788581189.519990:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.520026:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.520520:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084480 00000100:00100000:1.0:1788581189.520535:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084480 00000100:00100000:1.0:1788581189.520585:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788581189.520593:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184084480:12345-0@lo:101: 00010000:00010000:1.0:1788581189.520606:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581189.520618:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2f9e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.520638:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.520646:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.520661:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ae00, rc 0) 00000100:00100000:1.0:1788581189.520702:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184084480:12345-0@lo:101: Request processed in 110us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.520708:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788581189.520746:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184084480:0@lo:101: 00010000:00010000:1.0:1788581189.520758:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.520767:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581189.520821:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184084608:0@lo:501: 00000100:00100000:1.0:1788581189.520848:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.520869:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.520879:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084608 00000100:00100000:1.0:1788581189.520883:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084608 00000100:00100000:1.0:1788581189.520911:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788581189.520923:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184084608:12345-0@lo:501: 00000100:00100000:1.0:1788581189.520982:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184084608:12345-0@lo:501: Request processed in 60us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581189.520988:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788581189.521012:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184084608:0@lo:501: 10000000:01000000:1.0:1788581189.521033:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788581189.521039:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581189.521047:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581189.523999:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788581189.524117:0:8901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788581189.524142:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184084864:0@lo:7: 00000100:00100000:2.0:1788581189.524201:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.524247:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084864 00000100:00100000:2.0:1788581189.524274:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084864 00000100:00100000:2.0:1788581189.524316:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581189.524324:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184084864:12345-0@lo:7: 00000100:00100000:1.0:1788581189.524613:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581189.524625:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184084736:0@lo:13: 00000100:00100000:1.0:1788581189.524659:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.525322:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084736 00000100:00100000:1.0:1788581189.525329:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084736 00000100:00100000:1.0:1788581189.525369:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581189.525377:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875463184084736:12345-0@lo:13: 00002000:00000024:1.0:1788581189.525399:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:1.0:1788581189.525450:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875463184084736:12345-0@lo:13: Request processed in 73us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.525458:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581189.525675:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6faced80 x1875463184084736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581189.525698:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184084736:0@lo:13: 00000100:00100000:3.0:1788581189.525800:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581189.531567:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581189.531595:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184084992:0@lo:13: 00000100:00100000:1.0:1788581189.531663:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788581189.531705:0:8905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788581189.531983:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184084992 00000100:00100000:3.0:1788581189.531990:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184084992 00000100:00100000:3.0:1788581189.532055:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581189.532064:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184084992:12345-0@lo:13: 00002000:00000024:3.0:1788581189.532087:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:3.0:1788581189.532143:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184084992:12345-0@lo:13: Request processed in 79us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.532151:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788581189.532316:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581189.532505:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4225bb80 x1875463184084992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581189.532524:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184084992:0@lo:13: 00000100:00100000:1.0:1788581189.532575:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085120:0@lo:7: 00000100:00100000:1.0:1788581189.532604:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.532632:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.532649:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788581189.532657:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1788581189.534595:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788581189.534604:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788581189.534684:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184084864:12345-0@lo:7: Request processed in 10356us (10479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.534695:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581189.534719:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085120 00000100:00100000:3.0:1788581189.534726:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085120 00000100:00100000:3.0:1788581189.534766:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581189.534774:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8905:x1875463184085120:12345-0@lo:7: 00010000:00080000:2.0:1788581189.535360:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facdf80 x1875463184084864/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581189.535568:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184084864:0@lo:7: 00000004:00080000:2.0:1788581189.535581:0:8901:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788581189.535616:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184085248:0@lo:5: 00000100:00100000:2.0:1788581189.535655:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.535682:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.537310:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085248 00000100:00100000:3.0:1788581189.537320:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085248 00000100:00100000:2.0:1788581189.537415:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581189.537426:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184085248:12345-0@lo:5: 00002000:00080000:2.0:1788581189.537453:0:8906:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788581189.537515:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184085248:12345-0@lo:5: Request processed in 91us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.537522:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788581189.537558:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facdf80 x1875463184085248/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581189.537573:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184085248:0@lo:5: 00000004:00080000:2.0:1788581189.537584:0:8901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788581189.537618:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184085376:0@lo:5: 00000100:00100000:2.0:1788581189.537645:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581189.537664:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085376 00000100:00100000:3.0:1788581189.537668:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085376 00000100:00100000:2.0:1788581189.537669:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.537692:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581189.537700:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8901:x1875463184085376:12345-0@lo:5: 00002000:00080000:3.0:1788581189.537721:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:2.0:1788581189.547941:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788581189.547950:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788581189.548056:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8905:x1875463184085120:12345-0@lo:7: Request processed in 13279us (15447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581189.548066:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581189.548165:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258380 x1875463184085120/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.548181:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085120:0@lo:7: 00000004:00080000:0.0:1788581189.548194:0:8905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788581189.548237:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085504:0@lo:5: 00000100:00100000:0.0:1788581189.548292:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.548325:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581189.550566:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085504 00000100:00100000:2.0:1788581189.550579:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085504 00000100:00100000:2.0:1788581189.550630:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581189.550639:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8905:x1875463184085504:12345-0@lo:5: 00002000:00080000:2.0:1788581189.550678:0:8906:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788581189.550682:0:8906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788581189.555706:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8901:x1875463184085376:12345-0@lo:5: Request processed in 17999us (18052us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788581189.555720:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788581189.555958:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facdf80 x1875463184085376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581189.555975:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1875463184085376:0@lo:5: 00000004:00080000:2.0:1788581189.555990:0:8901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788581189.556033:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8901:1875463184085632:0@lo:900: 00000100:00100000:2.0:1788581189.556070:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.556117:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.556643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085632 00000100:00100000:3.0:1788581189.556650:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085632 00000100:00100000:3.0:1788581189.556710:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581189.556719:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8901:x1875463184085632:12345-0@lo:900: 00000100:00100000:3.0:1788581189.556775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8901:x1875463184085632:12345-0@lo:900: Request processed in 57us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581189.556782:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581189.556814:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facce00 x1875463184085632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581189.556826:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8901:1875463184085632:0@lo:900: 00000001:00080000:3.0:1788581189.563210:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788581189.563227:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788581189.563237:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788581189.563830:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8905:x1875463184085504:12345-0@lo:5: Request processed in 13187us (15532us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788581189.563841:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788581189.563969:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a3800 x1875463184085504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.563981:0:8905:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788581189.563987:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085504:0@lo:5: 00000004:00080000:0.0:1788581189.564000:0:8905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788581189.564040:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085760:0@lo:700: 00000100:00100000:0.0:1788581189.564073:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581189.564149:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.564192:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085760 00000100:00100000:3.0:1788581189.564199:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085760 00000100:00100000:2.0:1788581189.564466:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581189.564485:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1875463184085760:12345-0@lo:700: 00000100:00100000:0.0:1788581189.577714:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1875463184085760:12345-0@lo:700: Request processed in 13222us (13632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581189.577749:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581189.577805:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a3800 x1875463184085760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.577820:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085760:0@lo:700: 00000004:02000040:2.0:1788581189.590439:0:8905:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788581189.599760:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085888:0@lo:5: 00000100:00100000:2.0:1788581189.599849:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581189.600020:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581189.600110:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184085888 00000100:00100000:3.0:1788581189.600119:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184085888 00000100:00100000:3.0:1788581189.600180:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581189.600190:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8905:x1875463184085888:12345-0@lo:5: 00002000:00080000:3.0:1788581189.611687:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788581189.611707:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788581189.616467:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8905:x1875463184085888:12345-0@lo:5: Request processed in 16273us (16613us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788581189.616479:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788581189.616677:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e6facce00 x1875463184085888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581189.616694:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1875463184085888:0@lo:5: 00000004:00080000:0.0:1788581189.616708:0:8905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1788581189.960511:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581189.960547:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184086016:0@lo:41: 00000100:00100000:0.0:1788581189.960619:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581189.961163:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086016 00000100:00100000:1.0:1788581189.961173:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086016 00000100:00100000:1.0:1788581189.961230:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581189.961240:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184086016:12345-0@lo:41: 00000004:00000024:1.0:1788581189.961295:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788581189.961358:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184086016:12345-0@lo:41: Request processed in 120us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581189.961366:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581189.961490:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184086016:0@lo:41: 00000020:00000004:3.0:1788581189.988697:0:8938:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581189.988962:0:8938:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581190.338308:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581190.784359:0:8986:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581190.784370:0:8986:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788581191.362290:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581192.387038:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581192.513881:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184086144:0@lo:41: 00000100:00100000:3.0:1788581192.513945:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581192.514124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086144 00000100:00100000:1.0:1788581192.514302:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086144 00000100:00100000:1.0:1788581192.514408:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581192.514420:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184086144:12345-0@lo:41: 00000004:00000024:1.0:1788581192.514463:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788581192.516974:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184086144:12345-0@lo:41: Request processed in 2547us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581192.516988:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581192.517003:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184086144:0@lo:41: 00010000:00010000:1.0:1788581193.410186:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581194.436391:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581194.561779:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184086272:0@lo:400: 00000100:00100000:0.0:1788581194.561806:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184086528:0@lo:400: 00000100:00100000:0.0:1788581194.563462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.564573:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184086400:0@lo:400: 00000100:00100000:3.0:1788581194.564634:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.564688:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184086912:0@lo:400: 00000100:00100000:3.0:1788581194.564710:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.564734:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184087424:0@lo:13: 00000100:00100000:3.0:1788581194.564764:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.564808:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087424 00000100:00100000:3.0:1788581194.564815:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087424 00000100:00100000:3.0:1788581194.564869:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581194.564878:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184087424:12345-0@lo:13: 00002000:00000024:3.0:1788581194.564905:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581194.564948:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184087424:12345-0@lo:13: Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.564955:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581194.564994:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71ea9180 x1875463184087424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581194.565014:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184087424:0@lo:13: 00000100:00100000:0.0:1788581194.565106:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086400 00000100:00100000:0.0:1788581194.565111:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086400 00000100:00100000:0.0:1788581194.565146:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086912 00000100:00100000:0.0:1788581194.565150:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086912 00000100:00100000:0.0:1788581194.565165:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581194.565171:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184086400:12345-0@lo:400: 00000100:00100000:0.0:1788581194.565212:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184086400:12345-0@lo:400: Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.565218:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581194.565230:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581194.565236:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184086912:12345-0@lo:400: 00000100:00100000:0.0:1788581194.565299:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184086912:12345-0@lo:400: Request processed in 63us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.565304:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788581194.565342:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e477b4380 x1875463184086400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581194.565351:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184086400:0@lo:400: 00010000:00080000:0.0:1788581194.565360:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e10a80 x1875463184086912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581194.565367:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184086912:0@lo:400: 00000100:00100000:2.0:1788581194.565793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581194.565840:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184086784:0@lo:400: 00000100:00100000:2.0:1788581194.565875:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581194.565914:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086272 00000100:00100000:0.0:1788581194.565919:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086272 00000100:00100000:0.0:1788581194.565974:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788581194.565982:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3620:x1875463184086272:12345-0@lo:400: 00000100:00100000:0.0:1788581194.566018:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3620:x1875463184086272:12345-0@lo:400: Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.566023:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788581194.568811:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184086656:0@lo:400: 00000100:00100000:3.0:1788581194.568887:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.568932:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184087168:0@lo:400: 00000100:00100000:3.0:1788581194.568964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.568991:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581194.568997:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184087552:0@lo:13: 00000100:00100000:3.0:1788581194.569020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581194.569077:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087168 00000100:00100000:3.0:1788581194.569085:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087168 00000100:00100000:3.0:1788581194.569136:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581194.569145:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184087168:12345-0@lo:400: 00000100:00100000:3.0:1788581194.569194:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184087168:12345-0@lo:400: Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.569200:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581194.569222:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087552 00000100:00100000:3.0:1788581194.569226:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087552 00000100:00100000:3.0:1788581194.569242:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581194.569248:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184087552:12345-0@lo:13: 00002000:00000024:3.0:1788581194.569282:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581194.569311:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184087552:12345-0@lo:13: Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.569318:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788581194.569348:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71eaad80 x1875463184087552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581194.569358:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788581194.569380:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184087552:0@lo:13: 00010000:00080000:3.0:1788581194.569390:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e11880 x1875463184087168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581194.569398:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184087168:0@lo:400: 00000100:00100000:0.0:1788581194.569490:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086656 00000100:00100000:0.0:1788581194.569495:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086656 00000100:00100000:0.0:1788581194.569527:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581194.569534:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184086656:12345-0@lo:400: 00000100:00100000:0.0:1788581194.569573:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184086656:12345-0@lo:400: Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.569579:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788581194.569606:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e12680 x1875463184086656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581194.569614:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184086656:0@lo:400: 00000100:00100000:2.0:1788581194.570155:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184087296:0@lo:400: 00000100:00100000:2.0:1788581194.570185:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581194.570218:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184086272:0@lo:400: 00000100:00100000:2.0:1788581194.570247:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087296 00000100:00100000:2.0:1788581194.570275:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087296 00000100:00100000:2.0:1788581194.570307:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581194.570314:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184087296:12345-0@lo:400: 00000100:00100000:2.0:1788581194.570352:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184087296:12345-0@lo:400: Request processed in 38us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581194.570359:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581194.570388:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e13100 x1875463184087296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581194.570397:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184087296:0@lo:400: 00000100:00100000:0.0:1788581194.570510:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086528 00000100:00100000:0.0:1788581194.570515:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086528 00000100:00100000:0.0:1788581194.570546:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184086784 00000100:00100000:0.0:1788581194.570549:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184086784 00000100:00100000:0.0:1788581194.570565:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581194.570571:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184086528:12345-0@lo:400: 00000100:00100000:0.0:1788581194.570608:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184086528:12345-0@lo:400: Request processed in 37us (7153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.570615:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581194.570626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581194.570632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184086784:12345-0@lo:400: 00000100:00100000:0.0:1788581194.570676:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184086784:12345-0@lo:400: Request processed in 43us (4800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.570692:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581194.570751:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184086784:0@lo:400: 00000100:00080000:3.0:1788581194.572152:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581194.572160:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581194.572196:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184086528:0@lo:400: 00000100:00100000:3.0:1788581194.572220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184087040:0@lo:400: 00000100:00100000:3.0:1788581194.572301:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581194.572471:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087040 00000100:00100000:0.0:1788581194.572477:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087040 00000100:00100000:0.0:1788581194.572531:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581194.572541:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184087040:12345-0@lo:400: 00000100:00100000:0.0:1788581194.572588:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184087040:12345-0@lo:400: Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581194.572596:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788581194.572628:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e13480 x1875463184087040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581194.572639:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184087040:0@lo:400: 00000100:00080000:2.0:1788581194.572770:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581195.073726:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581195.073750:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184087680:0@lo:41: 00000100:00100000:2.0:1788581195.073813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581195.073923:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087680 00000100:00100000:0.0:1788581195.073931:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087680 00000100:00100000:0.0:1788581195.073979:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581195.073989:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184087680:12345-0@lo:41: 00000004:00000024:0.0:1788581195.074024:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788581195.074085:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184087680:12345-0@lo:41: Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581195.074092:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581195.074134:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184087680:0@lo:41: 00010000:00010000:1.0:1788581195.460025:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788581195.619283:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788581196.486558:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581197.505399:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581197.633740:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184087808:0@lo:41: 00000100:00100000:3.0:1788581197.633816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581197.634136:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087808 00000100:00100000:0.0:1788581197.634145:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087808 00000100:00100000:0.0:1788581197.634246:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581197.634282:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184087808:12345-0@lo:41: 00000004:00000024:0.0:1788581197.634315:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788581197.634361:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184087808:12345-0@lo:41: Request processed in 106us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581197.634381:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581197.636387:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184087808:0@lo:41: 00010000:00010000:1.0:1788581198.529607:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581199.555719:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788581199.634628:0:9484:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788581199.634702:0:9484:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788581199.634705:0:9484:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788581199.634884:0:9484:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e6f944800 00000020:01000004:0.0:1788581199.634900:0:9484:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788581199.634915:0:9484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788581199.634928:0:9484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff995e7fa04d28) 00000020:00000080:0.0:1788581199.634946:0:9484:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788581199.678720:0:9484:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788581199.679184:0:9484:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00000100:00100000:1.0:1788581199.682065:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184087936:0@lo:400: 00000100:00100000:1.0:1788581199.682138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.682181:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184088448:0@lo:400: 00000100:00100000:0.0:1788581199.682278:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184088064:0@lo:400: 00000100:00100000:0.0:1788581199.682311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.682332:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184088576:0@lo:400: 00000100:00100000:0.0:1788581199.682353:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.682377:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788581199.682382:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184088192:0@lo:400: 00000100:00100000:3.0:1788581199.682392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184088320:0@lo:400: 00000100:00100000:0.0:1788581199.682407:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.682431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184088704:0@lo:400: 00000100:00100000:3.0:1788581199.682436:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.682464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.682491:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088064 00000100:00100000:0.0:1788581199.682498:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088064 00000100:00100000:0.0:1788581199.682533:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088576 00000100:00100000:0.0:1788581199.682537:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088576 00000100:00100000:0.0:1788581199.682558:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088320 00000100:00100000:0.0:1788581199.682561:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088320 00000100:00100000:0.0:1788581199.682571:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088704 00000100:00100000:0.0:1788581199.682573:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088704 00000100:00100000:0.0:1788581199.682586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581199.682593:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184088064:12345-0@lo:400: 00000100:00100000:0.0:1788581199.682641:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184088064:12345-0@lo:400: Request processed in 48us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.682647:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581199.682672:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581199.682677:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184088576:12345-0@lo:400: 00000100:00100000:0.0:1788581199.682704:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184088576:12345-0@lo:400: Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.682710:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581199.682720:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581199.682725:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184088320:12345-0@lo:400: 00000100:00100000:0.0:1788581199.682750:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184088320:12345-0@lo:400: Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.682756:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581199.682766:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581199.682772:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184088704:12345-0@lo:400: 00000100:00100000:0.0:1788581199.682797:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184088704:12345-0@lo:400: Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.682802:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581199.682821:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088192 00000100:00100000:0.0:1788581199.682825:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088192 00000100:00100000:0.0:1788581199.682849:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581199.682855:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184088192:12345-0@lo:400: 00000100:00100000:0.0:1788581199.682885:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184088192:12345-0@lo:400: Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.682891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788581199.682909:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581199.682912:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581199.682938:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184088192:0@lo:400: 00010000:00080000:0.0:1788581199.682951:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258a80 x1875463184088704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.682969:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184088704:0@lo:400: 00010000:00080000:0.0:1788581199.682982:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258e00 x1875463184088064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.682991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184088064:0@lo:400: 00010000:00080000:0.0:1788581199.683001:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258380 x1875463184088576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.683010:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184088576:0@lo:400: 00000100:00100000:3.0:1788581199.683424:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184088832:0@lo:400: 00000100:00100000:3.0:1788581199.683481:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788581199.683520:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4225b800 x1875463184088320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581199.683532:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184088320:0@lo:400: 00000100:00100000:3.0:1788581199.683566:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184087936 00000100:00100000:3.0:1788581199.683571:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184087936 00000100:00100000:3.0:1788581199.683604:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788581199.683613:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3621:x1875463184087936:12345-0@lo:400: 00000100:00100000:3.0:1788581199.683653:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3621:x1875463184087936:12345-0@lo:400: Request processed in 42us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.683661:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788581199.683751:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184089216:0@lo:13: 00000100:00100000:3.0:1788581199.683783:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.683803:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581199.683808:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184089088:0@lo:13: 00000100:00100000:3.0:1788581199.683827:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.683868:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089216 00000100:00100000:3.0:1788581199.683872:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089216 00000100:00100000:1.0:1788581199.683889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.683899:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089088 00000100:00100000:3.0:1788581199.683903:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089088 00000100:00100000:1.0:1788581199.683916:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184088960:0@lo:400: 00000100:00100000:3.0:1788581199.683923:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581199.683932:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184089216:12345-0@lo:13: 00000100:00100000:1.0:1788581199.683943:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788581199.683957:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581199.683976:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184087936:0@lo:400: 00000100:00100000:3.0:1788581199.684001:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184089216:12345-0@lo:13: Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.684009:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581199.684022:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581199.684028:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184089088:12345-0@lo:13: 00002000:00000024:3.0:1788581199.684048:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581199.684072:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184089088:12345-0@lo:13: Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.684078:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788581199.684102:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d423adc00 x1875463184089088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581199.684116:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184089088:0@lo:13: 00010000:00080000:3.0:1788581199.684126:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d423ad880 x1875463184089216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581199.684133:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788581199.684147:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184089216:0@lo:13: 00000100:00100000:1.0:1788581199.684408:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088832 00000100:00100000:1.0:1788581199.684413:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088832 00000100:00100000:1.0:1788581199.684446:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088960 00000100:00100000:1.0:1788581199.684450:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088960 00000100:00100000:1.0:1788581199.684471:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581199.684479:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184088832:12345-0@lo:400: 00000100:00100000:1.0:1788581199.684530:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184088832:12345-0@lo:400: Request processed in 52us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.684537:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581199.684546:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42259880 x1875463184088832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581199.684556:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581199.684560:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184088832:0@lo:400: 00000100:00100000:1.0:1788581199.684568:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184088960:12345-0@lo:400: 00000100:00100000:1.0:1788581199.684606:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184088960:12345-0@lo:400: Request processed in 42us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.684623:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581199.684652:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42259f80 x1875463184088960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581199.684662:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184088960:0@lo:400: 00000100:00080000:0.0:1788581199.686059:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581199.686077:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184088448 00000100:00100000:0.0:1788581199.686084:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184088448 00000100:00100000:0.0:1788581199.686133:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581199.686142:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184088448:12345-0@lo:400: 00000100:00100000:0.0:1788581199.686224:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184088448:12345-0@lo:400: Request processed in 84us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.686231:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581199.686286:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184088448:0@lo:400: 00080000:01000000:1.0:1788581199.712234:0:9484:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788581199.712452:0:9484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788581199.712639:0:9484:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788581199.712650:0:9484:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b2f9f7 00000020:01000004:1.0:1788581199.712657:0:9484:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788581199.712678:0:9484:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788581199.712682:0:9484:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788581199.712688:0:9484:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788581199.712712:0:9484:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788581199.712716:0:9484:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788581199.745216:0:9484:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788581199.745373:0:9484:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788581199.745378:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788581199.745380:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581199.745382:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581199.745384:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581199.745386:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581199.745387:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581199.745389:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581199.745390:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581199.745612:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581199.745614:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581199.745616:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581199.745620:0:9484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788581199.745623:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581199.745625:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581199.745627:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581199.745628:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581199.745636:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581199.745638:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581199.745639:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581199.745640:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581199.745641:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581199.745642:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581199.745644:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581199.747582:0:9484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788581199.747612:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184089344:0@lo:253: 00000100:00100000:1.0:1788581199.747690:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.747982:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089344 00000100:00100000:3.0:1788581199.747991:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089344 00000100:00100000:3.0:1788581199.748059:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788581199.748069:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:9484:x1875463184089344:12345-0@lo:253: 20000000:01000000:3.0:1788581199.748099:0:6487:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788581199.748103:0:6487:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788581199.748108:0:6487:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788581199.748111:0:6487:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:1.0:1788581199.748155:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fe40 going to sleep for 11 seconds 00000040:00080000:3.0:1788581199.748643:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581199.748791:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788581199.748809:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788581199.748831:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788581199.748838:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788581199.748858:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788581199.748875:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788581199.748968:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788581199.748985:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1788581199.748987:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581199.749007:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788581199.749015:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581199.749046:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788581199.749053:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581199.749072:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788581199.749081:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788581199.749097:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788581199.749119:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788581199.749206:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788581199.749219:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1788581199.749221:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581199.749250:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788581199.749302:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581199.750669:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788581199.750683:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581199.750699:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788581199.750706:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788581199.750719:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788581199.750737:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788581199.751835:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788581199.751860:0:6487:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1788581199.751862:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788581199.751877:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788581199.751885:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788581199.751898:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788581199.751903:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1788581199.751914:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788581199.751920:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788581199.751930:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788581199.751943:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788581199.751957:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788581199.751959:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788581199.751963:0:6487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788581199.752008:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788581199.752010:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581199.758000:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581199.758077:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581199.758091:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788581199.759616:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788581199.759655:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788581199.759679:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788581199.759691:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788581199.759694:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788581199.763137:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788581199.763384:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788581199.763414:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788581199.763432:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1788581199.763460:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788581199.763463:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581199.768581:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581199.768634:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581199.768648:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788581199.769233:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788581199.769288:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788581199.769335:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788581199.769352:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788581199.769360:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581199.770416:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581199.770454:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581199.770469:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788581199.770601:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788581199.770623:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788581199.770639:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788581199.770649:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788581199.770651:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581199.771577:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581199.771610:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581199.771626:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788581199.775004:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788581199.775049:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788581199.775067:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1788581199.775090:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788581199.775111:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775128:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775136:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775143:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775149:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775158:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775180:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775187:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775195:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775234:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.775249:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.775985:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089472:0@lo:104: 00000100:00100000:1.0:1788581199.776062:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.776162:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.776172:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 21 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.776181:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089600:0@lo:104: 00000100:00100000:1.0:1788581199.776203:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.780886:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.780904:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 21 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.780935:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089728:0@lo:104: 00000100:00100000:1.0:1788581199.780989:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.781064:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089472 00000100:00100000:0.0:1788581199.781072:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089472 00000100:00100000:0.0:1788581199.781112:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089600 00000100:00100000:0.0:1788581199.781115:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089600 00000100:00100000:0.0:1788581199.781128:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581199.781136:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184089472:12345-0@lo:104: 00010000:00010000:0.0:1788581199.781150:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781210:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581199.781216:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184089472:12345-0@lo:104: Request processed in 81us (5154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.781224:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581199.781239:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581199.781246:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184089600:12345-0@lo:104: 00010000:00010000:0.0:1788581199.781266:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781303:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581199.781308:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184089600:12345-0@lo:104: Request processed in 64us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.781313:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788581199.781331:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581199.781337:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781350:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.781354:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781361:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.781368:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.781373:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.781402:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781407:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.781426:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781432:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2f9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9e9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781444:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581199.781447:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781464:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.781467:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781483:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.781488:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.781493:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.781507:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781512:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.781517:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781523:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b2f9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9bf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781530:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.781532:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.781533:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581199.781545:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184089856:0@lo:103: 00000100:00100000:0.0:1788581199.781573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.781600:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581199.781605:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184089984:0@lo:103: 00000100:00100000:0.0:1788581199.781624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.781653:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089856 00000100:00100000:0.0:1788581199.781657:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089856 00010000:00010000:0.0:1788581199.781674:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 22 pid: 6488 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.781704:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089984 00000100:00100000:0.0:1788581199.781708:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089984 00010000:00010000:0.0:1788581199.781719:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 23 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.781736:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581199.781742:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3620:x1875463184089856:12345-0@lo:103: 00010000:00010000:0.0:1788581199.781752:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.781757:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 23 pid: 6488 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.781766:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 23 pid: 6488 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.784121:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.784240:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.784333:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3620:x1875463184089856:12345-0@lo:103: Request processed in 2586us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.784344:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581199.784376:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581199.784387:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3620:x1875463184089984:12345-0@lo:103: 00010000:00010000:0.0:1788581199.784402:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.784409:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 22 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.784421:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 22 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.784431:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.784480:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3620:x1875463184089984:12345-0@lo:103: Request processed in 97us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.784486:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581199.784594:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184089984:0@lo:103: 00000100:00100000:3.0:1788581199.784603:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184089856:0@lo:103: 00010000:00010000:1.0:1788581199.785683:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.785698:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 21 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.785711:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090112:0@lo:104: 00000100:00100000:1.0:1788581199.785752:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.785841:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.785851:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 21 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.785859:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090240:0@lo:104: 00000100:00100000:1.0:1788581199.785899:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.785922:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.785929:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 21 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.785936:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090368:0@lo:104: 00000100:00100000:1.0:1788581199.785960:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.785977:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.785997:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 21 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.786005:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090496:0@lo:104: 00000100:00100000:1.0:1788581199.786027:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788581199.786055:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2f9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9e2 expref: 21 pid: 6488 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.786067:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089472:0@lo:104: 00010000:00010000:1.0:1788581199.786081:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b2f9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9b8 expref: 20 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.786088:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089600:0@lo:104: 00000100:00100000:0.0:1788581199.786568:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581199.786588:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.786601:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184089728 00000100:00100000:0.0:1788581199.786606:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184089728 00000100:00100000:0.0:1788581199.786639:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090112 00000100:00100000:0.0:1788581199.786642:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090112 00000100:00100000:0.0:1788581199.786650:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090240 00000100:00100000:0.0:1788581199.786652:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090240 00000100:00100000:0.0:1788581199.786659:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090368 00000100:00100000:0.0:1788581199.786662:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090368 00000100:00100000:0.0:1788581199.786669:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090496 00000100:00100000:0.0:1788581199.786671:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090496 00000100:00100000:0.0:1788581199.786682:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581199.786689:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+7:6487:x1875463184089728:12345-0@lo:104: 00010000:00010000:0.0:1788581199.786701:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.786752:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581199.786757:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+7:6487:x1875463184089728:12345-0@lo:104: Request processed in 69us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.786763:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788581199.786873:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581199.786879:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.786887:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581199.786890:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.786909:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581199.786916:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581199.786921:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581199.786950:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.786957:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581199.786974:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.786992:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b2f99c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.787005:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581199.787006:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581199.787008:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581199.787021:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581199.787043:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184090624:0@lo:103: 00000100:00100000:3.0:1788581199.787075:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.787441:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581199.787460:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6487:x1875463184090112:12345-0@lo:104: 00010000:00010000:0.0:1788581199.787469:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.787511:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581199.787524:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:6487:x1875463184090112:12345-0@lo:104: Request processed in 75us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.787530:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581199.787545:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581199.787552:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6487:x1875463184090240:12345-0@lo:104: 00010000:00010000:0.0:1788581199.787560:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.787594:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581199.787599:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:6487:x1875463184090240:12345-0@lo:104: Request processed in 49us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.787604:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581199.787616:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581199.787622:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184090368:12345-0@lo:104: 00010000:00010000:0.0:1788581199.787629:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.787654:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581199.787659:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6487:x1875463184090368:12345-0@lo:104: Request processed in 38us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.787666:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581199.787694:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581199.787700:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184090496:12345-0@lo:104: 00010000:00010000:0.0:1788581199.787707:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.787731:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788581199.787741:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6487:x1875463184090496:12345-0@lo:104: Request processed in 42us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.787747:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788581199.787768:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1788581199.788588:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184089728:0@lo:104: 00000100:00100000:1.0:1788581199.788599:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090112:0@lo:104: 00000100:00100000:1.0:1788581199.788605:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090240:0@lo:104: 00000100:00100000:1.0:1788581199.788611:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090368:0@lo:104: 00000100:00100000:1.0:1788581199.788618:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6487:1875463184090496:0@lo:104: 00010000:00010000:1.0:1788581199.788648:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788871:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788879:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40030a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.788883:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788891:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.788897:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.788903:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.788949:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788956:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.788976:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788983:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2f972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f979 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.788997:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581199.789000:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789022:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.789025:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789032:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.789052:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.789057:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.789073:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789079:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.789093:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789100:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b2f956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f95d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789111:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581199.789114:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789120:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.789122:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789140:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.789147:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.789153:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.789168:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789173:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.789178:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789184:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2f917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f91e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789193:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581199.789197:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789202:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.789205:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789211:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.789217:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.789229:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.789241:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789247:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.789271:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789278:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6bc00/0x50f0cc74b7b2f8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8f4 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789291:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.789293:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.789295:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581199.789310:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184091008:0@lo:103: 00000100:00100000:0.0:1788581199.789359:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.789388:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581199.789394:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184090880:0@lo:103: 00000100:00100000:0.0:1788581199.789413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.789440:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090624 00000100:00100000:0.0:1788581199.789446:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090624 00010000:00010000:0.0:1788581199.789470:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 20 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.789491:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091008 00000100:00100000:0.0:1788581199.789494:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091008 00010000:00010000:0.0:1788581199.789503:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 21 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.789525:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090880 00000100:00100000:0.0:1788581199.789528:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090880 00010000:00010000:0.0:1788581199.789538:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 22 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.789549:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581199.789556:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3619:x1875463184090624:12345-0@lo:103: 00010000:00010000:0.0:1788581199.789568:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.789572:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 22 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789582:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 22 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789594:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2f9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f99c expref: 22 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789606:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.789634:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3619:x1875463184090624:12345-0@lo:103: Request processed in 78us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.789640:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581199.789654:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581199.789660:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7143b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3621:x1875463184091008:12345-0@lo:103: 00010000:00010000:0.0:1788581199.789668:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.789672:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 20 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789679:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 20 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789694:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2f91e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f917 expref: 20 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.789702:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.789729:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7143b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3621:x1875463184091008:12345-0@lo:103: Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.789735:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581199.790964:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581199.790986:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:3621:x1875463184090880:12345-0@lo:103: 00010000:00010000:0.0:1788581199.790999:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.791006:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 18 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791017:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 18 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791032:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2f95d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f956 expref: 18 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791056:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.791101:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3621:x1875463184090880:12345-0@lo:103: Request processed in 124us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.791107:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581199.791143:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184091136:0@lo:103: 00000100:00100000:0.0:1788581199.791174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.791219:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581199.791225:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184090752:0@lo:103: 00000100:00100000:0.0:1788581199.791282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.791307:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091136 00000100:00100000:0.0:1788581199.791313:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091136 00010000:00010000:0.0:1788581199.791332:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 17 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.791352:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184090752 00000100:00100000:0.0:1788581199.791354:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184090752 00010000:00010000:0.0:1788581199.791366:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 18 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.791378:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581199.791383:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:3618:x1875463184091136:12345-0@lo:103: 00010000:00010000:0.0:1788581199.791390:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.791394:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 18 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791401:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 18 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791410:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2f8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ed expref: 18 pid: 6486 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791420:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.791445:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3618:x1875463184091136:12345-0@lo:103: Request processed in 62us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.791451:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581199.791463:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581199.791468:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3618:x1875463184090752:12345-0@lo:103: 00010000:00010000:0.0:1788581199.791475:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.791486:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 16 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791496:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 16 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791505:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2f979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f972 expref: 16 pid: 6487 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791517:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791523:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791537:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791543:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791549:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791554:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791560:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581199.791563:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791570:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791587:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.791595:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.791617:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:3618:x1875463184090752:12345-0@lo:103: Request processed in 149us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.791623:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581199.791660:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184090624:0@lo:103: 00000100:00100000:0.0:1788581199.791686:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184090880:0@lo:103: 00000100:00100000:0.0:1788581199.791693:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184091008:0@lo:103: 00000100:00100000:0.0:1788581199.791710:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184090752:0@lo:103: 00000100:00100000:0.0:1788581199.791716:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184091136:0@lo:103: 00010000:00010000:0.0:1788581199.791732:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581199.791839:0:6487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.791848:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.791867:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2f9fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581199.791880:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788581199.803082:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:9484:x1875463184089344:12345-0@lo:253: Request processed in 55005us (55383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.803096:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788581199.803182:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184089344:0@lo:253: 10000000:01000000:1.0:1788581199.803198:0:9484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788581199.803201:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581199.803203:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581199.803204:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581199.803205:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788581199.803206:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581199.803208:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581199.803209:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581199.803211:0:9484:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788581199.803213:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581199.803215:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581199.803238:0:9484:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e6f944800 from lustre-OST0001 10000000:01000000:1.0:1788581199.803323:0:9484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788581199.803327:0:9484:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788581199.803336:0:9484:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7557cd28 local copy 10000000:01000000:1.0:1788581199.803339:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788581199.803373:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.803384:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.803394:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.803412:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091264:0@lo:101: 00000100:00100000:1.0:1788581199.803464:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.803504:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.803559:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091264 00000100:00100000:2.0:1788581199.803565:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091264 00000100:00100000:2.0:1788581199.803611:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788581199.803619:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+14:9484:x1875463184091264:12345-0@lo:101: 00010000:00010000:2.0:1788581199.803631:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.803644:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2fa0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa05 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.803667:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa05 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.803676:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa05 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.803684:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f000, rc 0) 00000100:00100000:2.0:1788581199.803720:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091264:12345-0@lo:101: Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.803727:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788581199.803752:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091264:0@lo:101: 00010000:00010000:1.0:1788581199.803767:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.803777:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.803855:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091392:0@lo:501: 00000100:00100000:1.0:1788581199.804004:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.805030:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.805239:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091392 00000100:00100000:2.0:1788581199.805247:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091392 00000100:00100000:2.0:1788581199.805436:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788581199.805446:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091392:12345-0@lo:501: 00000100:00100000:1.0:1788581199.805660:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091392:0@lo:501: 10000000:01000000:1.0:1788581199.805681:0:9484:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788581199.805703:0:9484:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000100:00100000:2.0:1788581199.805775:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091392:12345-0@lo:501: Request processed in 110us (1549us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581199.805784:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:1.0:1788581199.805857:0:9484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.805867:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.805874:0:9484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.805898:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788581199.805927:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e6f944800 10000000:01000000:1.0:1788581199.805931:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581199.805937:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788581199.805944:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581199.806011:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788581199.806015:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788581199.806122:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.806131:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.806140:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.806157:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091520:0@lo:101: 00000100:00100000:1.0:1788581199.806191:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581199.806282:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581199.806290:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806297:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581199.806301:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806309:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581199.806316:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581199.806321:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581199.806342:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806349:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581199.806368:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806380:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fa05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x50f0cc74b7b2fa0c expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806392:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581199.806393:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581199.806395:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581199.806406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184091648:0@lo:103: 00000100:00100000:2.0:1788581199.806430:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091520 00000100:00100000:3.0:1788581199.806437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581199.806437:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091520 00000100:00100000:2.0:1788581199.806471:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788581199.806480:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091520:12345-0@lo:101: 00000100:00100000:3.0:1788581199.806489:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091648 00010000:00010000:2.0:1788581199.806490:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788581199.806494:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091648 00010000:00010000:2.0:1788581199.806504:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa13 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.806525:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.806533:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788581199.806536:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.806544:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3619:x1875463184091648:12345-0@lo:103: 00010000:00010000:2.0:1788581199.806548:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00010000:00010000:3.0:1788581199.806555:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581199.806568:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b2fa0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa05 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.806579:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581199.806605:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:3619:x1875463184091648:12345-0@lo:103: Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.806611:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581199.806631:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.806645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184091648:0@lo:103: 00000100:00100000:2.0:1788581199.806817:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091520:12345-0@lo:101: Request processed in 337us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.806824:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788581199.806881:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091520:0@lo:101: 00010000:00010000:1.0:1788581199.806892:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.806901:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.807112:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091776:0@lo:501: 00000100:00100000:1.0:1788581199.807141:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.807200:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.807235:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091776 00000100:00100000:2.0:1788581199.807239:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091776 00000100:00100000:0.0:1788581199.807313:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788581199.807323:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091776:12345-0@lo:501: 00000100:00100000:0.0:1788581199.807432:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091776:12345-0@lo:501: Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.807440:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788581199.807458:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091776:0@lo:501: 00000100:00100000:1.0:1788581199.807488:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091904:0@lo:503: 00000100:00100000:1.0:1788581199.807528:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.807577:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.807612:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184091904 00000100:00100000:0.0:1788581199.807617:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184091904 00000100:00100000:0.0:1788581199.807651:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788581199.807660:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091904:12345-0@lo:503: 00000100:00100000:0.0:1788581199.807741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184091904:12345-0@lo:503: Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.807756:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788581199.807801:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184091904:0@lo:503: 00000040:00080000:1.0:1788581199.808243:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581199.808438:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092032:0@lo:502: 00000100:00100000:1.0:1788581199.808474:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.808505:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.810601:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092032 00000100:00100000:0.0:1788581199.810615:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092032 00000100:00100000:0.0:1788581199.810677:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788581199.810687:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184092032:12345-0@lo:502: 00000100:00100000:0.0:1788581199.810856:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184092032:12345-0@lo:502: Request processed in 170us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.810864:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788581199.811157:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092032:0@lo:502: 00000040:00080000:1.0:1788581199.811919:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788581199.811963:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788581199.811980:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788581199.811994:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788581199.812008:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788581199.812022:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788581199.814157:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092160:0@lo:502: 00000100:00100000:1.0:1788581199.814242:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.814320:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.814334:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092160 00000100:00100000:0.0:1788581199.814342:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092160 00000100:00100000:0.0:1788581199.814397:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788581199.814407:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184092160:12345-0@lo:502: 00000100:00100000:0.0:1788581199.814603:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184092160:12345-0@lo:502: Request processed in 196us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.814611:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788581199.815249:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092160:0@lo:502: 00000040:00080000:2.0:1788581199.815376:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788581199.815391:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788581199.818247:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788581199.818535:0:9495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788581199.818542:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581199.818544:0:9495:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788581199.818553:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581199.818569:0:9495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff995e81dcb370) 00000020:00000080:3.0:1788581199.818606:0:9495:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788581199.818613:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581199.818695:0:9495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f944800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788581199.818705:0:9495:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581199.818784:0:9495:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b2fa28 00010000:00010000:3.0:1788581199.826646:0:9495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788581199.827142:0:9495:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788581199.830238:0:9495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788581199.830796:0:9495:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788581199.836505:0:9495:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788581199.836869:0:9495:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788581199.849164:0:9495:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788581199.851173:0:9495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788581199.851185:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581199.851191:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581199.851194:0:9495:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788581199.851197:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581199.851201:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581199.851203:0:9495:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581199.851212:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581199.851214:0:9495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581199.851233:0:9495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581199.851236:0:9495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581199.851237:0:9495:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581199.851240:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788581199.851607:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788581199.851640:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788581199.851657:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.851669:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581199.851677:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f944800 from 1 10000000:01000000:3.0:1788581199.851680:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581199.851722:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.851731:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.851742:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.851775:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092288:0@lo:101: 00000100:00100000:3.0:1788581199.851841:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.851889:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.852045:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092288 00000100:00100000:2.0:1788581199.852053:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092288 00000100:00100000:2.0:1788581199.852104:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788581199.852114:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:9484:x1875463184092288:12345-0@lo:101: 00010000:00010000:2.0:1788581199.852127:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.852138:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa2f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.852159:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.852169:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.852177:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e000, rc 0) 00000100:00100000:2.0:1788581199.852218:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092288:12345-0@lo:101: Request processed in 104us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.852224:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788581199.854202:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092288:0@lo:101: 00010000:00010000:3.0:1788581199.854227:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.854239:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.854374:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092416:0@lo:501: 00000100:00100000:3.0:1788581199.854421:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.854455:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.854488:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092416 00000100:00100000:3.0:1788581199.854493:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092416 00000100:00100000:3.0:1788581199.854526:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788581199.854534:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092416:12345-0@lo:501: 00000100:00100000:3.0:1788581199.854622:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092416:12345-0@lo:501: Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.854629:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788581199.854662:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092416:0@lo:501: 00000100:00100000:3.0:1788581199.854684:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092544:0@lo:503: 00000100:00100000:3.0:1788581199.855371:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.855393:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.855408:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092544 00000100:00100000:3.0:1788581199.855418:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092544 00000100:00100000:3.0:1788581199.855439:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788581199.855445:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092544:12345-0@lo:503: 00000100:00100000:3.0:1788581199.855536:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092544:12345-0@lo:503: Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.855543:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788581199.855582:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092544:0@lo:503: 00000040:00080000:3.0:1788581199.856027:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581199.856113:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092672:0@lo:502: 00000100:00100000:3.0:1788581199.856161:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.856178:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.856193:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092672 00000100:00100000:3.0:1788581199.856197:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092672 00000100:00100000:3.0:1788581199.856224:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581199.856232:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092672:12345-0@lo:502: 00000100:00100000:3.0:1788581199.856878:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092672:12345-0@lo:502: Request processed in 646us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.856909:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788581199.857400:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092672:0@lo:502: 00000040:00080000:2.0:1788581199.857685:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788581199.857861:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788581199.857896:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092800:0@lo:502: 00000100:00100000:2.0:1788581199.857944:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581199.857986:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.858926:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092800 00000100:00100000:0.0:1788581199.858935:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092800 00000100:00100000:0.0:1788581199.858986:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788581199.858996:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092800:12345-0@lo:502: 00000100:00100000:0.0:1788581199.859141:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092800:12345-0@lo:502: Request processed in 146us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.859148:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788581199.859200:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092800:0@lo:502: 00000040:00080000:2.0:1788581199.859326:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788581199.859336:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788581199.863173:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581199.863183:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581199.863186:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581199.863192:0:9500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6f944800 00000020:00000080:2.0:1788581199.863195:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581199.863205:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581199.863207:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581199.863208:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788581199.863211:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788581199.863645:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788581199.863676:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581199.863791:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.863804:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581199.863860:0:9484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788581199.863863:0:9484:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e6f944800 10000000:01000000:3.0:1788581199.863872:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e6f944800 10000000:01000000:3.0:1788581199.863877:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581199.863882:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6f944800 from 1 10000000:01000000:3.0:1788581199.863885:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581199.863919:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.863928:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.863939:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.864029:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092928:0@lo:101: 00000100:00100000:3.0:1788581199.864110:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.864189:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42e59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.864547:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184092928 00000100:00100000:2.0:1788581199.864554:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184092928 00000100:00100000:2.0:1788581199.864642:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788581199.864654:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9484:x1875463184092928:12345-0@lo:101: 00010000:00010000:2.0:1788581199.864667:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.864681:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa3d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.864703:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.864782:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.864791:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581199.864847:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184092928:12345-0@lo:101: Request processed in 195us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.864853:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788581199.864932:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184092928:0@lo:101: 00010000:00010000:1.0:1788581199.864946:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.864966:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.865066:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093056:0@lo:501: 00000100:00100000:1.0:1788581199.865095:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.865232:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.865374:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093056 00000100:00100000:3.0:1788581199.865379:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093056 00000100:00100000:3.0:1788581199.865404:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788581199.865410:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093056:12345-0@lo:501: 00000100:00100000:3.0:1788581199.865628:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093056:12345-0@lo:501: Request processed in 216us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.865636:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788581199.865722:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093056:0@lo:501: 00000100:00100000:1.0:1788581199.865761:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093184:0@lo:503: 00000100:00100000:1.0:1788581199.865799:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.865824:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.865833:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093184 00000100:00100000:0.0:1788581199.865839:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093184 00000100:00100000:0.0:1788581199.865871:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788581199.865878:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093184:12345-0@lo:503: 00000100:00100000:0.0:1788581199.865969:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093184:12345-0@lo:503: Request processed in 90us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.865975:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788581199.866193:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093184:0@lo:503: 00000040:00080000:1.0:1788581199.866564:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581199.866633:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093312:0@lo:502: 00000100:00100000:1.0:1788581199.866669:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.866696:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.866781:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093312 00000100:00100000:0.0:1788581199.866785:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093312 00000100:00100000:0.0:1788581199.866807:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788581199.866813:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093312:12345-0@lo:502: 00000100:00100000:0.0:1788581199.866898:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093312:12345-0@lo:502: Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.866905:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788581199.867845:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093312:0@lo:502: 00000040:00080000:1.0:1788581199.868152:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788581199.868184:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788581199.868199:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788581199.868213:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788581199.868227:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788581199.868240:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788581199.868270:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788581199.868371:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788581199.868387:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788581199.868400:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788581199.868412:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788581199.868441:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788581199.868458:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788581199.868548:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788581199.868563:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788581199.868576:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788581199.868589:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788581199.868603:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788581199.868617:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788581199.868631:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788581199.868655:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788581199.868669:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788581199.868683:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788581199.868697:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788581199.868841:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788581199.868861:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788581199.868876:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788581199.868903:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788581199.868918:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788581199.868931:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788581199.868944:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788581199.869048:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788581199.869065:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788581199.869079:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788581199.869093:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788581199.869106:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788581199.869119:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788581199.869132:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788581199.869146:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1788581199.869159:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1788581199.869173:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1788581199.869185:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788581199.869198:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788581199.869226:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788581199.869241:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788581199.869647:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788581199.869695:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093440:0@lo:502: 00000100:00100000:3.0:1788581199.869823:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581199.869890:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42e59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.869939:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093440 00000100:00100000:2.0:1788581199.870015:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093440 00000100:00100000:2.0:1788581199.870814:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788581199.870826:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093440:12345-0@lo:502: 00000100:00100000:2.0:1788581199.871184:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184093440:12345-0@lo:502: Request processed in 361us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.871192:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788581199.871841:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184093440:0@lo:502: 00000040:00080000:3.0:1788581199.871924:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788581199.871944:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788581199.872863:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788581199.872879:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff995d41c019b8) 00000020:00000080:1.0:1788581199.872903:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788581199.873141:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f944800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581199.873145:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f944800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581199.873148:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f944800 3 00010000:00080000:1.0:1788581199.873176:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d42e9a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581199.876897:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788581199.877234:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788581199.877360:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581199.877372:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x50f0cc74b7b2fa52 00000100:00080000:1.0:1788581199.877382:0:9501:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581199.877388:0:9501:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995d42e9a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581199.877421:0:9501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d423e6300 x1875463184093568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581199.877448:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788581199.878149:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184093568:0@lo:38: 00000100:00100000:3.0:1788581199.878224:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.878666:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184093824:0@lo:400: 00000100:00100000:0.0:1788581199.878701:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.878791:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184094336:0@lo:400: 00000100:00100000:0.0:1788581199.878816:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.878835:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788581199.878841:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184093696:0@lo:400: 00000100:00100000:0.0:1788581199.878863:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.878879:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184094208:0@lo:400: 00000100:00100000:0.0:1788581199.878900:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.878920:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184093952:0@lo:400: 00000100:00100000:0.0:1788581199.878941:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.879156:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093568 00000100:00100000:1.0:1788581199.879164:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093568 00000100:00100000:1.0:1788581199.879188:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094336 00000100:00100000:1.0:1788581199.879190:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094336 00000100:00100000:1.0:1788581199.879209:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093696 00000100:00100000:1.0:1788581199.879212:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093696 00000100:00100000:1.0:1788581199.879222:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094208 00000100:00100000:1.0:1788581199.879225:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094208 00000100:00100000:1.0:1788581199.879235:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093952 00000100:00100000:1.0:1788581199.879238:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093952 00000100:00100000:1.0:1788581199.879350:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581199.879362:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184094336:12345-0@lo:400: 00000100:00100000:0.0:1788581199.879430:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184094464:0@lo:400: 00000100:00100000:1.0:1788581199.883652:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184094336:12345-0@lo:400: Request processed in 4287us (4830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.883667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581199.883699:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581199.884830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.884876:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788581199.884889:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184094080:0@lo:400: 00000100:00100000:0.0:1788581199.884940:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.885090:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184094592:0@lo:400: 00000100:00100000:0.0:1788581199.885115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.885154:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184093824 00000100:00100000:0.0:1788581199.885161:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184093824 00000100:00100000:0.0:1788581199.885198:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094080 00000100:00100000:0.0:1788581199.885200:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094080 00000100:00100000:0.0:1788581199.885213:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581199.885221:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184093824:12345-0@lo:400: 00000100:00100000:0.0:1788581199.885535:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184093824:12345-0@lo:400: Request processed in 314us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.885543:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581199.885560:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581199.885566:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184094080:12345-0@lo:400: 00000100:00100000:0.0:1788581199.885602:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184094080:12345-0@lo:400: Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.885608:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581199.885628:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581199.885636:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788581199.885649:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581199.885657:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581199.885662:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184093568:12345-0@lo:38: 00010000:00080000:0.0:1788581199.885683:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00100000:1.0:1788581199.885808:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184093696:12345-0@lo:400: 00000100:00100000:1.0:1788581199.885848:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184093696:12345-0@lo:400: Request processed in 2141us (6984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.885855:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581199.885870:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788581199.885886:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581199.885893:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184094208:12345-0@lo:400: 00000100:00100000:1.0:1788581199.885923:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184094208:12345-0@lo:400: Request processed in 31us (7023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.885929:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581199.885939:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788581199.885945:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581199.886091:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184093952:12345-0@lo:400: 00000100:00100000:1.0:1788581199.886124:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184093952:12345-0@lo:400: Request processed in 36us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.886130:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:0.0:1788581199.886845:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x50f0cc74b7b2fa59 00000004:00100000:0.0:1788581199.886862:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581199.886900:0:6494:0:(import.c:65:import_set_state_nolock()) ffff995d42c2a000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788581199.887422:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d423e6300 x1875463184093568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581199.887436:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581199.887443:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788581199.887451:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581199.887456:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581199.887458:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581199.887535:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184093568:0@lo:38: 00000100:00100000:1.0:1788581199.887658:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094464 00000100:00100000:1.0:1788581199.887664:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094464 00000100:00100000:1.0:1788581199.887697:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094592 00000100:00100000:1.0:1788581199.887700:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094592 00000100:00100000:0.0:1788581199.887797:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875463184093568:12345-0@lo:38: Request processed in 2131us (9571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.887813:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581199.887919:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581199.887928:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184094464:12345-0@lo:400: 00000100:00100000:1.0:1788581199.888062:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581199.888069:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184094592:12345-0@lo:400: 00000100:00100000:0.0:1788581199.888124:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184094464:12345-0@lo:400: Request processed in 197us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.888130:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581199.888163:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184094080:0@lo:400: 00010000:00080000:0.0:1788581199.888178:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258700 x1875463184093952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.888188:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184093952:0@lo:400: 00010000:00080000:0.0:1788581199.888198:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42259f80 x1875463184094464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.888205:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184094464:0@lo:400: 00000020:01000004:2.0:1788581199.890237:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788581199.890276:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff995e7a73b370) 00000020:00000080:2.0:1788581199.890310:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788581199.890397:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6f944800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788581199.890401:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f944800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788581199.890404:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f944800 3 00010000:00080000:2.0:1788581199.890432:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d42c3d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00080000:0.0:1788581199.892440:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4225b800 x1875463184093696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.892458:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184093696:0@lo:400: 00010000:00080000:0.0:1788581199.892483:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258380 x1875463184094208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.892491:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184094208:0@lo:400: 00000100:00100000:0.0:1788581199.892502:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184093824:0@lo:400: 00010000:00080000:0.0:1788581199.892511:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d42258a80 x1875463184094336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.892532:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184094336:0@lo:400: 00010000:00010000:2.0:1788581199.894699:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788581199.895107:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788581199.895154:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788581199.895166:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x50f0cc74b7b2fa67 00000100:00080000:2.0:1788581199.895175:0:9501:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581199.895180:0:9501:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff995d42c3d000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581199.895209:0:9501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e71e10380 x1875463184094720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581199.895280:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184094720:0@lo:38: 00000100:00100000:0.0:1788581199.895346:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581199.895520:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788581199.895583:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9503:1875463184094848:0@lo:901: 00000100:00100000:2.0:1788581199.895624:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581199.895641:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.895808:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094848 00000100:00100000:3.0:1788581199.895814:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094848 00000100:00100000:3.0:1788581199.895856:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581199.895866:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9503:x1875463184094848:12345-0@lo:901: 00000100:00100000:3.0:1788581199.895977:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9503:x1875463184094848:12345-0@lo:901: Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.895983:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788581199.896002:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581199.897427:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184094592:12345-0@lo:400: Request processed in 9354us (12306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.897446:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788581199.897839:0:9503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e13480 x1875463184094848/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788581215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581199.897868:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9503:1875463184094848:0@lo:901: 00000100:00100000:3.0:1788581199.899418:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094720 00000100:00100000:3.0:1788581199.899429:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094720 00000100:00100000:3.0:1788581199.899834:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581199.899843:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184094720:12345-0@lo:38: 00010000:00080000:3.0:1788581199.899874:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788581199.899911:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x50f0cc74b7b2fa6e 00000004:00100000:3.0:1788581199.899926:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581199.899974:0:6493:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4f000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788581199.901741:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a1180 x1875463184094592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.901758:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184094592:0@lo:400: 00000100:00100000:3.0:1788581199.902656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875463184094720:12345-0@lo:38: Request processed in 2808us (7304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.902666:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788581199.902868:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e71e10380 x1875463184094720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581199.902880:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581199.902888:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788581199.902895:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788581199.902899:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788581199.902902:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d42c3d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581199.902910:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184094720:0@lo:38: 00000040:00080000:2.0:1788581199.903520:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788581199.903736:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788581199.903768:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581199.903791:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.903803:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581199.903856:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581199.903858:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581199.903859:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581199.903860:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581199.903862:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581199.903863:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581199.903864:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581199.903866:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581199.903867:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581199.903869:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581199.903870:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581199.903873:0:9484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788581199.903876:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581199.903877:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581199.903878:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581199.903879:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581199.903880:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581199.903881:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581199.903883:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581199.903884:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581199.903885:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581199.903886:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581199.903887:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581199.903910:0:9484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788581199.903926:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184094976:0@lo:253: 00000100:00100000:1.0:1788581199.904176:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.904221:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581199.904430:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184094976 00000100:00100000:2.0:1788581199.904437:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184094976 00000100:00100000:2.0:1788581199.904492:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581199.904503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184094976:12345-0@lo:253: 20000000:01000000:2.0:1788581199.904528:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788581199.904543:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788581199.912675:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788581199.912784:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788581199.913082:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9484:x1875463184094976:12345-0@lo:253: Request processed in 8577us (8902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.913094:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788581199.913408:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9484:1875463184094976:0@lo:253: 10000000:01000000:3.0:1788581199.913422:0:9484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788581199.913425:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581199.913427:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581199.913428:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581199.913429:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581199.913440:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581199.913441:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581199.913442:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581199.913444:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581199.913445:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581199.913447:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581199.913448:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788581199.913474:0:9484:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788581199.917522:0:6509:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788581199.917533:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788581199.917561:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917579:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917587:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917593:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917637:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917651:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 16 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.917665:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184095104:0@lo:104: 00000100:00100000:1.0:1788581199.917738:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581199.917795:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.917804:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 16 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.917812:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184095232:0@lo:104: 00000100:00100000:1.0:1788581199.917833:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581199.917870:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.917994:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095104 00000100:00100000:0.0:1788581199.918002:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095104 00000100:00100000:0.0:1788581199.918050:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095232 00000100:00100000:0.0:1788581199.918053:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095232 00000100:00100000:0.0:1788581199.918068:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581199.918077:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184095104:12345-0@lo:104: 00010000:00010000:0.0:1788581199.918090:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918148:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581199.918155:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:6509:x1875463184095104:12345-0@lo:104: Request processed in 79us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.918167:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581199.918183:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581199.918189:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184095232:12345-0@lo:104: 00010000:00010000:0.0:1788581199.918198:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918232:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581199.918237:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:6509:x1875463184095232:12345-0@lo:104: Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.918242:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788581199.918272:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581199.918278:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918285:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ec00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.918288:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918296:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.918303:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.918308:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.918334:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918341:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.918366:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918374:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0ec00/0x50f0cc74b7b2f9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f9b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918388:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581199.918391:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918397:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581199.918400:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918407:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581199.918412:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581199.918417:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581199.918431:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918437:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581199.918442:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918447:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4600/0x50f0cc74b7b2f964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f96b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918459:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.918466:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.918468:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581199.918482:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184095488:0@lo:103: 00000100:00100000:0.0:1788581199.918512:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.918534:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581199.918539:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184095360:0@lo:103: 00000100:00100000:0.0:1788581199.918558:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581199.918583:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095488 00000100:00100000:0.0:1788581199.918586:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095488 00010000:00010000:0.0:1788581199.918605:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 17 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.918622:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095360 00000100:00100000:0.0:1788581199.918625:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095360 00010000:00010000:0.0:1788581199.918634:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 18 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.918649:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581199.918655:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:3621:x1875463184095488:12345-0@lo:103: 00010000:00010000:0.0:1788581199.918664:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.918669:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 18 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918678:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 18 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918691:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.918733:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:3621:x1875463184095488:12345-0@lo:103: Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.918739:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581199.918758:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581199.918763:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3621:x1875463184095360:12345-0@lo:103: 00010000:00010000:0.0:1788581199.918770:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581199.918775:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 17 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918784:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 17 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918795:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918803:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788581199.918815:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006994419s 00010000:00010000:0.0:1788581199.918820:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918826:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918833:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918840:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918845:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581199.918849:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918868:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918876:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.918885:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581199.918907:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3621:x1875463184095360:12345-0@lo:103: Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.918913:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581199.918945:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184095360:0@lo:103: 00000100:00100000:0.0:1788581199.918953:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184095488:0@lo:103: 00010000:00010000:1.0:1788581199.919100:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40030600/0x50f0cc74b7b2f9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f9aa expref: 16 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.919112:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184095104:0@lo:104: 00010000:00010000:1.0:1788581199.919122:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031600/0x50f0cc74b7b2f96b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f964 expref: 15 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.919130:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6509:1875463184095232:0@lo:104: 00010000:00010000:1.0:1788581199.919143:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.919151:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.919157:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.919164:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fa75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.919867:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788581199.920966:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788581199.921140:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788581199.921374:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788581199.921518:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788581199.921698:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788581199.922164:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788581199.925165:0:9484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788581199.933932:0:9484:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788581199.933940:0:9484:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788581199.933978:0:9484:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581199.934023:0:9484:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581199.934055:0:9484:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788581199.934073:0:9484:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788581199.934884:0:9484:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581199.935087:0:9484:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788581200.194374:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581200.194399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184095616:0@lo:41: 00000100:00100000:0.0:1788581200.194672:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581200.194722:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095616 00000100:00100000:2.0:1788581200.194731:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095616 00000100:00100000:2.0:1788581200.194781:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581200.194791:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184095616:12345-0@lo:41: 00000004:00000024:2.0:1788581200.194998:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788581200.195121:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184095616:12345-0@lo:41: Request processed in 330us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.195129:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581200.195652:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184095616:0@lo:41: 00010000:00010000:1.0:1788581200.579116:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788581200.784997:0:9558:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581200.785232:0:9558:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581201.605343:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581202.625873:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581202.762588:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184095744:0@lo:41: 00000100:00100000:3.0:1788581202.762656:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581202.762818:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095744 00000100:00100000:1.0:1788581202.762825:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095744 00000100:00100000:1.0:1788581202.762960:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581202.762972:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184095744:12345-0@lo:41: 00000004:00000024:1.0:1788581202.763004:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788581202.763071:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184095744:12345-0@lo:41: Request processed in 101us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581202.763078:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581202.763140:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184095744:0@lo:41: 00010000:00010000:0.0:1788581203.649460:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581204.675053:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581204.802437:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184095872:0@lo:13: 00000100:00100000:0.0:1788581204.802505:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581204.802559:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581204.802566:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184096000:0@lo:13: 00000100:00100000:0.0:1788581204.802589:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581204.802630:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184095872 00000100:00100000:0.0:1788581204.802638:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184095872 00000100:00100000:0.0:1788581204.802681:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096000 00000100:00100000:0.0:1788581204.802692:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096000 00000100:00100000:0.0:1788581204.802713:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581204.802721:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184095872:12345-0@lo:13: 00002000:00000024:0.0:1788581204.802761:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581204.802802:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184095872:12345-0@lo:13: Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581204.802809:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581204.802824:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581204.802831:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184096000:12345-0@lo:13: 00002000:00000024:0.0:1788581204.802840:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581204.802861:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184096000:12345-0@lo:13: Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581204.802866:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788581204.802880:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581204.802903:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d42258700 x1875463184096000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581204.802931:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184096000:0@lo:13: 00010000:00080000:0.0:1788581204.802943:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13480 x1875463184095872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581204.802953:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184095872:0@lo:13: 00000100:00100000:2.0:1788581205.315248:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184096128:0@lo:400: 00000100:00100000:2.0:1788581205.315351:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315398:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184096640:0@lo:400: 00000100:00100000:2.0:1788581205.315455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315476:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184097152:0@lo:400: 00000100:00100000:2.0:1788581205.315508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315534:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788581205.315540:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184096256:0@lo:400: 00000100:00100000:2.0:1788581205.315567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315586:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184096768:0@lo:400: 00000100:00100000:2.0:1788581205.315610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315627:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184097280:0@lo:400: 00000100:00100000:0.0:1788581205.315755:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096256 00000100:00100000:0.0:1788581205.315764:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096256 00000100:00100000:2.0:1788581205.315802:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581205.315815:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096768 00000100:00100000:0.0:1788581205.315820:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096768 00000100:00100000:2.0:1788581205.315847:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184096384:0@lo:400: 00000100:00100000:0.0:1788581205.315847:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097280 00000100:00100000:0.0:1788581205.315851:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097280 00000100:00100000:0.0:1788581205.315874:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581205.315885:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581205.315893:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184096256:12345-0@lo:400: 00000100:00100000:2.0:1788581205.315907:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184096896:0@lo:400: 00000100:00100000:2.0:1788581205.315937:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.315953:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184097408:0@lo:400: 00000100:00100000:0.0:1788581205.315965:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184096256:12345-0@lo:400: Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.315973:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581205.315996:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581205.316011:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096896 00000100:00100000:0.0:1788581205.316016:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096896 00000100:00100000:2.0:1788581205.316024:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581205.316033:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184096512:0@lo:400: 00000100:00100000:2.0:1788581205.316056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.316069:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184097024:0@lo:400: 00000100:00100000:2.0:1788581205.316088:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.316105:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184097536:0@lo:41: 00000100:00100000:2.0:1788581205.316123:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581205.316152:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096128 00000100:00100000:2.0:1788581205.316156:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096128 00000100:00100000:0.0:1788581205.316164:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097408 00000100:00100000:0.0:1788581205.316170:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097408 00000100:00100000:2.0:1788581205.316190:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788581205.316194:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096512 00000100:00100000:0.0:1788581205.316198:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096512 00000100:00100000:2.0:1788581205.316202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:3618:x1875463184096128:12345-0@lo:400: 00000100:00100000:0.0:1788581205.316226:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581205.316235:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184096768:12345-0@lo:400: 00000100:00100000:2.0:1788581205.316250:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:3618:x1875463184096128:12345-0@lo:400: Request processed in 51us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.316283:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788581205.316313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096640 00000100:00100000:2.0:1788581205.316318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096640 00000100:00100000:2.0:1788581205.316335:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184096384 00000100:00100000:2.0:1788581205.316338:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184096384 00000100:00100000:2.0:1788581205.316348:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097536 00000100:00100000:2.0:1788581205.316351:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097536 00000100:00100000:2.0:1788581205.316361:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581205.316368:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184096640:12345-0@lo:400: 00000100:00100000:2.0:1788581205.316403:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184096640:12345-0@lo:400: Request processed in 35us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.316410:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581205.316426:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788581205.316438:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184096768:12345-0@lo:400: Request processed in 204us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.316445:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581205.316456:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581205.316460:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184097280:12345-0@lo:400: 00000100:00100000:0.0:1788581205.316478:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184097280:12345-0@lo:400: Request processed in 19us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.316482:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581205.316487:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581205.316490:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184096896:12345-0@lo:400: 00000100:00100000:0.0:1788581205.316508:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184096896:12345-0@lo:400: Request processed in 18us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.316512:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581205.316517:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581205.316520:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184097408:12345-0@lo:400: 00000100:00100000:0.0:1788581205.316543:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184097408:12345-0@lo:400: Request processed in 23us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.316547:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581205.316554:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581205.316557:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184096512:12345-0@lo:400: 00000100:00100000:0.0:1788581205.316570:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184096512:12345-0@lo:400: Request processed in 13us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.316573:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788581205.316586:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581205.316590:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581205.317047:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1875463184096384:12345-0@lo:400: 00000100:00100000:2.0:1788581205.317086:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1875463184096384:12345-0@lo:400: Request processed in 654us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.317093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581205.317108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581205.317115:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184097536:12345-0@lo:41: 00000004:00000024:2.0:1788581205.317136:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788581205.317165:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184097536:12345-0@lo:41: Request processed in 51us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.317171:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581205.317191:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097152 00000100:00100000:2.0:1788581205.317196:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097152 00000100:00100000:2.0:1788581205.317232:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097024 00000100:00100000:2.0:1788581205.317235:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097024 00000100:00100000:2.0:1788581205.317274:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581205.317281:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184097152:12345-0@lo:400: 00000100:00100000:0.0:1788581205.317304:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581205.317316:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184097024:12345-0@lo:400: 00000100:00100000:2.0:1788581205.317318:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184097152:12345-0@lo:400: Request processed in 37us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.317328:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581205.317361:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184097024:12345-0@lo:400: Request processed in 48us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.317369:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788581205.317384:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e11880 x1875463184096256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317400:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184096256:0@lo:400: 00010000:00080000:2.0:1788581205.317415:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7100 x1875463184096768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317423:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184096768:0@lo:400: 00010000:00080000:2.0:1788581205.317749:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4700 x1875463184097280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317761:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184097280:0@lo:400: 00000100:00100000:2.0:1788581205.317776:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184096128:0@lo:400: 00000100:00100000:2.0:1788581205.317787:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184096640:0@lo:400: 00010000:00080000:2.0:1788581205.317797:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4e00 x1875463184097152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317805:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184097152:0@lo:400: 00010000:00080000:2.0:1788581205.317859:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13480 x1875463184096512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317868:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184096512:0@lo:400: 00010000:00080000:2.0:1788581205.317888:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a5180 x1875463184097024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317896:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184097024:0@lo:400: 00000100:00100000:2.0:1788581205.317912:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184097536:0@lo:41: 00000100:00100000:2.0:1788581205.317920:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184096384:0@lo:400: 00010000:00080000:2.0:1788581205.317930:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4380 x1875463184096896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317938:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184096896:0@lo:400: 00010000:00080000:2.0:1788581205.317948:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7800 x1875463184097408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581205.317956:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184097408:0@lo:400: 00000001:02000400:2.0:1788581205.528966:0:9848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788581205.699547:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581206.292167:0:9900:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581206.292787:0:9900:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581206.721834:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788581206.857134:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788581206.857141:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6f8e1800 from 39 10000000:01000000:1.0:1788581206.857146:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581206.857186:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857199:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857210:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581206.857234:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097664:0@lo:101: 00000100:00100000:1.0:1788581206.857322:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581206.857382:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581206.857406:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097664 00000100:00100000:1.0:1788581206.857413:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097664 00000100:00100000:1.0:1788581206.857469:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788581206.857479:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184097664:12345-0@lo:101: 00010000:00010000:1.0:1788581206.857492:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581206.857513:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857537:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857547:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857556:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581206.857593:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184097664:12345-0@lo:101: Request processed in 116us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.857600:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788581206.857662:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097664:0@lo:101: 00010000:00010000:1.0:1788581206.857677:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581206.857686:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581206.857738:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097792:0@lo:501: 00000100:00100000:1.0:1788581206.857760:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581206.857784:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.858633:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097792 00000100:00100000:3.0:1788581206.858641:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097792 00000100:00100000:3.0:1788581206.858688:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788581206.858696:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184097792:12345-0@lo:501: 00000100:00100000:3.0:1788581206.858831:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184097792:12345-0@lo:501: Request processed in 136us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.858839:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788581206.858875:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097792:0@lo:501: 00000100:00100000:3.0:1788581206.858909:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097920:0@lo:503: 00000100:00100000:3.0:1788581206.858951:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.858969:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.858981:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184097920 00000100:00100000:3.0:1788581206.858984:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184097920 00000100:00100000:3.0:1788581206.859017:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581206.859023:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184097920:12345-0@lo:503: 00000100:00100000:3.0:1788581206.859098:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184097920:12345-0@lo:503: Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.859104:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581206.859140:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184097920:0@lo:503: 00000100:00100000:3.0:1788581206.859325:0:9936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9936:1875463184098048:0@lo:502: 00000100:00100000:3.0:1788581206.859374:0:9936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.859393:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098048 00000100:00100000:3.0:1788581206.859396:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098048 00000100:00100000:3.0:1788581206.859416:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788581206.859422:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9936:x1875463184098048:12345-0@lo:502: 00000100:00100000:3.0:1788581206.859493:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9936:x1875463184098048:12345-0@lo:502: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.859500:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788581206.859527:0:9936:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.859539:0:9936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9936:1875463184098048:0@lo:502: 00000100:00100000:3.0:1788581206.859577:0:9936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9936:1875463184098176:0@lo:502: 00000100:00100000:3.0:1788581206.859609:0:9936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.859627:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098176 00000100:00100000:3.0:1788581206.859630:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098176 00000100:00100000:3.0:1788581206.859649:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788581206.859662:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9936:x1875463184098176:12345-0@lo:502: 00000100:00100000:3.0:1788581206.859717:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:9936:x1875463184098176:12345-0@lo:502: Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.859723:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788581206.859749:0:9936:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.859761:0:9936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9936:1875463184098176:0@lo:502: 00000040:00080000:3.0:1788581206.859780:0:9936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788581206.859826:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788581206.859845:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581206.859854:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.859864:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581206.859872:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788581206.859874:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788581206.859876:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788581206.859896:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.859903:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.859911:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581206.859922:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098304:0@lo:101: 00000100:00100000:3.0:1788581206.859948:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.859981:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.860007:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098304 00000100:00100000:3.0:1788581206.860011:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098304 00000100:00100000:3.0:1788581206.860032:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581206.860039:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184098304:12345-0@lo:101: 00010000:00010000:3.0:1788581206.860047:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581206.860057:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa8a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.860075:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.860084:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.860092:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5800, rc 0) 00000100:00100000:3.0:1788581206.860124:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098304:12345-0@lo:101: Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.860130:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581206.860157:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098304:0@lo:101: 00010000:00010000:3.0:1788581206.860167:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.860175:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581206.860211:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098432:0@lo:501: 00000100:00100000:3.0:1788581206.860235:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.860249:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.860285:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098432 00000100:00100000:3.0:1788581206.860289:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098432 00000100:00100000:3.0:1788581206.860307:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581206.860312:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098432:12345-0@lo:501: 00000100:00100000:3.0:1788581206.860389:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098432:12345-0@lo:501: Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.860396:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581206.860424:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098432:0@lo:501: 00000100:00100000:3.0:1788581206.860446:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098560:0@lo:503: 00000100:00100000:3.0:1788581206.860476:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.860489:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.860500:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098560 00000100:00100000:3.0:1788581206.860503:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098560 00000100:00100000:3.0:1788581206.860522:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788581206.860527:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098560:12345-0@lo:503: 00000100:00100000:3.0:1788581206.860590:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098560:12345-0@lo:503: Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.860597:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788581206.860630:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098560:0@lo:503: 00000100:00100000:3.0:1788581206.860812:0:9937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9937:1875463184098688:0@lo:502: 00000100:00100000:3.0:1788581206.860845:0:9937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.860862:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098688 00000100:00100000:3.0:1788581206.860866:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098688 00000100:00100000:3.0:1788581206.860884:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788581206.860890:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9937:x1875463184098688:12345-0@lo:502: 00000100:00100000:3.0:1788581206.860955:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9937:x1875463184098688:12345-0@lo:502: Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.860967:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788581206.861006:0:9937:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.861018:0:9937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9937:1875463184098688:0@lo:502: 00000020:01000000:3.0:1788581206.861037:0:9937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581206.861044:0:9937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581206.861046:0:9937:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581206.861050:0:9937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581206.861051:0:9937:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788581206.861065:0:9937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9937:1875463184098816:0@lo:502: 00000100:00100000:3.0:1788581206.861095:0:9937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.861112:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098816 00000100:00100000:3.0:1788581206.861115:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098816 00000100:00100000:3.0:1788581206.861133:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788581206.861138:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9937:x1875463184098816:12345-0@lo:502: 00000100:00100000:3.0:1788581206.861192:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:9937:x1875463184098816:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.861198:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788581206.861224:0:9937:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.861236:0:9937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9937:1875463184098816:0@lo:502: 00000020:01000000:3.0:1788581206.861274:0:9937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581206.861279:0:9937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581206.861280:0:9937:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788581206.861284:0:9937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788581206.861321:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788581206.861336:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581206.861343:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861360:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581206.861368:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581206.861370:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4f1e6000 from 39 10000000:01000000:3.0:1788581206.861373:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581206.861390:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861397:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861405:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581206.861417:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098944:0@lo:101: 00000100:00100000:3.0:1788581206.861441:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.861453:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.861464:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184098944 00000100:00100000:3.0:1788581206.861468:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184098944 00000100:00100000:3.0:1788581206.861487:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788581206.861493:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184098944:12345-0@lo:101: 00010000:00010000:3.0:1788581206.861500:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581206.861510:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fa98 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861525:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861545:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861552:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4000, rc 0) 00000100:00100000:3.0:1788581206.861581:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184098944:12345-0@lo:101: Request processed in 87us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.861586:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788581206.861615:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184098944:0@lo:101: 00010000:00010000:3.0:1788581206.861626:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.861633:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581206.861668:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099072:0@lo:501: 00000100:00100000:3.0:1788581206.861692:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.861704:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.861713:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099072 00000100:00100000:3.0:1788581206.861717:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099072 00000100:00100000:3.0:1788581206.861735:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788581206.861741:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184099072:12345-0@lo:501: 00000100:00100000:3.0:1788581206.861818:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184099072:12345-0@lo:501: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.861824:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788581206.861851:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099072:0@lo:501: 00000100:00100000:3.0:1788581206.861876:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099200:0@lo:503: 00000100:00100000:3.0:1788581206.861913:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581206.861925:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e43fa9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.861934:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099200 00000100:00100000:3.0:1788581206.861937:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099200 00000100:00100000:3.0:1788581206.861955:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788581206.861960:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184099200:12345-0@lo:503: 00000100:00100000:3.0:1788581206.866691:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184099200:12345-0@lo:503: Request processed in 4721us (4769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.866705:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788581206.867487:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099200:0@lo:503: 00000100:00100000:2.0:1788581206.867977:0:9938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9938:1875463184099328:0@lo:502: 00000100:00100000:2.0:1788581206.868046:0:9938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.868083:0:9938:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.868570:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099328 00000100:00100000:0.0:1788581206.868578:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099328 00000100:00100000:0.0:1788581206.868651:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788581206.868661:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:9938:x1875463184099328:12345-0@lo:502: 00000100:00100000:0.0:1788581206.868786:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:9938:x1875463184099328:12345-0@lo:502: Request processed in 125us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.868793:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788581206.868882:0:9938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9938:1875463184099328:0@lo:502: 00000100:00100000:2.0:1788581206.868929:0:9938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9938:1875463184099456:0@lo:502: 00000100:00100000:2.0:1788581206.868963:0:9938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.877202:0:9938:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.878439:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099456 00000100:00100000:3.0:1788581206.878451:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099456 00000100:00100000:3.0:1788581206.878501:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788581206.878511:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:9938:x1875463184099456:12345-0@lo:502: 00000100:00100000:3.0:1788581206.878664:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:9938:x1875463184099456:12345-0@lo:502: Request processed in 153us (9699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.878671:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788581206.878838:0:9938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9938:1875463184099456:0@lo:502: 00000040:00080000:2.0:1788581206.878872:0:9938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788581206.879032:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788581206.879052:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581206.879062:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.879073:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581206.879082:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788581206.879085:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4f1e6000 from 6 10000000:01000000:0.0:1788581206.879087:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581206.879117:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.879125:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.879134:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581206.879150:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099584:0@lo:101: 00000100:00100000:0.0:1788581206.879186:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.879218:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.879434:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099584 00000100:00100000:3.0:1788581206.879440:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099584 00000100:00100000:3.0:1788581206.879464:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788581206.879471:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184099584:12345-0@lo:101: 00010000:00010000:3.0:1788581206.879481:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581206.879494:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b2faad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2faa6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.879515:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b2faad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2faa6 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.879525:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b2faad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2faa6 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.879543:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4e00, rc 0) 00000100:00100000:3.0:1788581206.879583:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184099584:12345-0@lo:101: Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.879589:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788581206.880465:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099584:0@lo:101: 00010000:00010000:2.0:1788581206.880489:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.880498:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.880553:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099712:0@lo:256: 00000100:00100000:2.0:1788581206.880594:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.880623:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.880681:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099712 00000100:00100000:0.0:1788581206.880686:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099712 00000100:00100000:0.0:1788581206.880721:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788581206.880728:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184099712:12345-0@lo:256: 20000000:01000000:0.0:1788581206.880743:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581206.880758:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581206.880761:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788581206.880846:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184099712:12345-0@lo:256: Request processed in 118us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.880854:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788581206.880875:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099712:0@lo:256: 10000000:01000000:0.0:1788581206.880917:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581206.880923:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.880931:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581206.880939:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788581206.880941:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788581206.880943:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581206.880959:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.880966:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.880974:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581206.880985:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099840:0@lo:101: 00000100:00100000:0.0:1788581206.881019:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.881027:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.881042:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099840 00000100:00100000:0.0:1788581206.881045:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099840 00000100:00100000:0.0:1788581206.881059:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788581206.881064:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184099840:12345-0@lo:101: 00010000:00010000:0.0:1788581206.881077:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581206.881086:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fab4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.881101:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.881109:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.881116:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40030a00, rc 0) 00000100:00100000:0.0:1788581206.881140:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184099840:12345-0@lo:101: Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.881146:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788581206.881165:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099840:0@lo:101: 00010000:00010000:0.0:1788581206.881174:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.881181:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581206.881229:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099968:0@lo:501: 00000100:00100000:0.0:1788581206.881288:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.881298:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.881325:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184099968 00000100:00100000:0.0:1788581206.881329:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184099968 00000100:00100000:0.0:1788581206.881594:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788581206.881602:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184099968:12345-0@lo:501: 00000100:00100000:0.0:1788581206.881715:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184099968:12345-0@lo:501: Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.881721:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788581206.882785:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184099968:0@lo:501: 00000100:00100000:2.0:1788581206.882828:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184100096:0@lo:503: 00000100:00100000:2.0:1788581206.882877:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.883033:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.883080:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100096 00000100:00100000:3.0:1788581206.883085:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100096 00000100:00100000:3.0:1788581206.883113:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788581206.883119:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184100096:12345-0@lo:503: 00000100:00100000:3.0:1788581206.883249:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184100096:12345-0@lo:503: Request processed in 129us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.883269:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788581206.886014:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184100096:0@lo:503: 00000100:00100000:1.0:1788581206.887666:0:9942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9942:1875463184100224:0@lo:502: 00000100:00100000:1.0:1788581206.887744:0:9942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581206.887792:0:9942:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.887873:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100224 00000100:00100000:2.0:1788581206.887880:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100224 00000100:00100000:2.0:1788581206.887932:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788581206.887941:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:9942:x1875463184100224:12345-0@lo:502: 00000100:00100000:2.0:1788581206.888084:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:9942:x1875463184100224:12345-0@lo:502: Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.888092:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581206.888218:0:9942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9942:1875463184100224:0@lo:502: 00000020:01000000:1.0:1788581206.888246:0:9942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581206.888289:0:9942:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788581206.888297:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581206.888299:0:9942:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788581206.888305:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581206.888309:0:9942:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1788581206.888331:0:9942:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788581206.888529:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581206.888556:0:9942:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff995d42c019b8) 00000020:00000080:1.0:1788581206.888580:0:9942:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788581206.888588:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581206.888681:0:9942:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788581206.888687:0:9942:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788581206.888695:0:9942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b2fac9 00010000:00080000:1.0:1788581206.888723:0:9942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d41e5e000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581206.888955:0:9942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788581206.889087:0:9942:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788581206.889099:0:9942:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788581206.890848:0:9942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581206.891073:0:9942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581206.891211:0:9942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788581206.891323:0:9942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788581206.898247:0:9944:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581206.898270:0:9944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788581206.898841:0:9942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581206.898853:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788581206.898894:0:9942:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788581206.898918:0:9942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2fad0 00000100:00080000:0.0:1788581206.898927:0:9942:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581206.898933:0:9942:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d41e5e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581206.898964:0:9942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d42258380 x1875463184100352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581206.898999:0:9942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788581206.899025:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184100352:0@lo:8: 00000020:01000000:0.0:1788581206.899063:0:9942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581206.899067:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581206.899069:0:9942:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788581206.899072:0:9942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581206.899075:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581206.899077:0:9942:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788581206.899079:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788581206.899081:0:9942:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788581206.899089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.899103:0:9942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9942:1875463184100480:0@lo:502: 00000100:00100000:0.0:1788581206.899143:0:9942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.899168:0:9942:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581206.899225:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100480 00000100:00100000:1.0:1788581206.899232:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100480 00000100:00100000:1.0:1788581206.899293:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788581206.899302:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:9942:x1875463184100480:12345-0@lo:502: 00000100:00100000:1.0:1788581206.899407:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:9942:x1875463184100480:12345-0@lo:502: Request processed in 105us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.899437:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100352 00000100:00100000:2.0:1788581206.899441:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100352 00000100:00100000:2.0:1788581206.899464:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581206.899469:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184100352:12345-0@lo:8: 00010000:00080000:2.0:1788581206.899491:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000100:00100000:1.0:1788581206.899493:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000020:00000080:2.0:1788581206.899519:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b2fad7 00002000:00100000:2.0:1788581206.899532:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff995d42c39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788581206.899536:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788581206.899540:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788581206.899597:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581206.899808:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788581206.899831:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995d42c3f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581206.899883:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184100352:12345-0@lo:8: Request processed in 412us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.899890:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581206.899924:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184100608:0@lo:400: 00000100:00100000:2.0:1788581206.899953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.899975:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184101120:0@lo:400: 00000100:00100000:2.0:1788581206.900008:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900024:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184101632:0@lo:400: 00000100:00100000:2.0:1788581206.900051:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900071:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788581206.900077:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184100736:0@lo:400: 00000100:00100000:2.0:1788581206.900101:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900119:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184101248:0@lo:400: 00000100:00100000:2.0:1788581206.900138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900156:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184101760:0@lo:400: 00000100:00100000:2.0:1788581206.900175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900198:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184100864:0@lo:400: 00000100:00100000:2.0:1788581206.900217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184101376:0@lo:400: 00000100:00100000:2.0:1788581206.900276:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900294:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581206.900300:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184100992:0@lo:400: 00000100:00100000:2.0:1788581206.900320:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900476:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184101504:0@lo:400: 00000100:00100000:2.0:1788581206.900500:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900531:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101376 00000100:00100000:2.0:1788581206.900535:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101376 00000100:00100000:2.0:1788581206.900569:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101504 00000100:00100000:2.0:1788581206.900572:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101504 00000100:00100000:2.0:1788581206.900589:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581206.900596:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184101376:12345-0@lo:400: 00000100:00100000:2.0:1788581206.900635:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184101376:12345-0@lo:400: Request processed in 40us (358us total) trans 0 rc 0/0 00010000:00080000:1.0:1788581206.900641:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d42258380 x1875463184100352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581206.900642:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581206.900651:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788581206.900653:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581206.900658:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184101504:12345-0@lo:400: 00000100:00080000:1.0:1788581206.900660:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788581206.900667:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581206.900671:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788581206.900674:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d41e5e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581206.900682:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184101504:12345-0@lo:400: Request processed in 25us (181us total) trans 0 rc 0/0 00000004:00080000:1.0:1788581206.900685:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788581206.900688:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581206.900690:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184100352:0@lo:8: 00000100:00100000:2.0:1788581206.900703:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100608 00000100:00100000:2.0:1788581206.900706:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100608 00000004:00080000:1.0:1788581206.900712:0:9944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788581206.900722:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101120 00000100:00100000:2.0:1788581206.900724:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101120 00000100:00100000:2.0:1788581206.900732:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101632 00000100:00100000:2.0:1788581206.900734:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101632 00000100:00100000:2.0:1788581206.900743:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101248 00000100:00100000:2.0:1788581206.900744:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101248 00000004:00080000:1.0:1788581206.900760:0:9944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 193042505748ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788581206.900763:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101760 00000100:00100000:2.0:1788581206.900765:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101760 00080000:00080000:1.0:1788581206.900766:0:9944:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788581206.900774:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100864 00000100:00100000:2.0:1788581206.900776:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100864 00000100:00100000:2.0:1788581206.900791:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581206.900796:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184100608:12345-0@lo:400: 00000100:00100000:1.0:1788581206.900806:0:9946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184101888:0@lo:700: 00000100:00100000:1.0:1788581206.900828:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900831:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184100608:12345-0@lo:400: Request processed in 35us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.900837:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581206.900849:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581206.900849:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184101888 00000100:00100000:1.0:1788581206.900852:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184101888 00000100:00100000:2.0:1788581206.900854:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184101120:12345-0@lo:400: 00000100:00100000:1.0:1788581206.900878:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581206.900880:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184101120:12345-0@lo:400: Request processed in 27us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.900883:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9946:x1875463184101888:12345-0@lo:700: 00000100:00100000:2.0:1788581206.900886:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581206.900896:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581206.900901:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184101632:12345-0@lo:400: 00000100:00100000:1.0:1788581206.900907:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8417:1875463184102016:0@lo:700: 00000100:00100000:2.0:1788581206.900925:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184101632:12345-0@lo:400: Request processed in 24us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.900930:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.900931:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581206.900942:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581206.900944:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.900947:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184101248:12345-0@lo:400: 00000100:00100000:1.0:1788581206.900956:0:9946:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.900973:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184101248:12345-0@lo:400: Request processed in 26us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.900979:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788581206.901000:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788581206.901007:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184101760:12345-0@lo:400: 00000100:00100000:2.0:1788581206.901034:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184101760:12345-0@lo:400: Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.901047:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788581206.901061:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581206.901066:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184100864:12345-0@lo:400: 00000100:00100000:2.0:1788581206.901095:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184100864:12345-0@lo:400: Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.901100:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581206.901124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100736 00000100:00100000:2.0:1788581206.901128:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100736 00000100:00100000:2.0:1788581206.901157:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184100992 00000100:00100000:2.0:1788581206.901160:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184100992 00000100:00100000:2.0:1788581206.901173:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581206.901179:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184100736:12345-0@lo:400: 00000100:00100000:2.0:1788581206.901210:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184100736:12345-0@lo:400: Request processed in 32us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.901216:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581206.901226:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581206.901231:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184100992:12345-0@lo:400: 00000100:00100000:2.0:1788581206.901279:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184100992:12345-0@lo:400: Request processed in 47us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.901284:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788581206.901314:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581206.901317:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581206.901466:0:9942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9942:1875463184100480:0@lo:502: 00000020:01000000:0.0:1788581206.901497:0:9942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581206.901505:0:9942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581206.901507:0:9942:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788581206.901526:0:9942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1788581206.902325:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184100992:0@lo:400: 00010000:00080000:1.0:1788581206.902341:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e10a80 x1875463184101504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902364:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184101504:0@lo:400: 00010000:00080000:1.0:1788581206.902378:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4e00 x1875463184100864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902387:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184100864:0@lo:400: 00010000:00080000:1.0:1788581206.902398:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7800 x1875463184101376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902406:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184101376:0@lo:400: 00000100:00100000:1.0:1788581206.902511:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184100736:0@lo:400: 00010000:00080000:1.0:1788581206.902523:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7b80 x1875463184101248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902530:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184101248:0@lo:400: 00010000:00080000:1.0:1788581206.902543:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e10380 x1875463184101760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184101760:0@lo:400: 00010000:00080000:1.0:1788581206.902560:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4380 x1875463184100608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902568:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184100608:0@lo:400: 00010000:00080000:1.0:1788581206.902577:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7100 x1875463184101120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902585:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184101120:0@lo:400: 00010000:00080000:1.0:1788581206.902595:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13480 x1875463184101632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.902608:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184101632:0@lo:400: 00000100:00100000:2.0:1788581206.903861:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102016 00000100:00100000:2.0:1788581206.903873:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102016 00000100:00100000:2.0:1788581206.903925:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581206.903935:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8417:x1875463184102016:12345-0@lo:700: 00000020:01000000:2.0:1788581206.904085:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788581206.904123:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788581206.904133:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.904144:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581206.904154:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788581206.904156:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3a800 from 39 10000000:01000000:2.0:1788581206.904159:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581206.904188:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.904197:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.904206:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.904225:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102144:0@lo:101: 00000100:00100000:2.0:1788581206.904315:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.904558:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102144 00000100:00100000:0.0:1788581206.904564:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102144 00000100:00100000:0.0:1788581206.904601:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788581206.904609:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184102144:12345-0@lo:101: 00010000:00010000:0.0:1788581206.904617:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581206.904628:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fade expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.904647:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.904657:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581206.904665:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40031400, rc 0) 00000100:00100000:0.0:1788581206.904701:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102144:12345-0@lo:101: Request processed in 93us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.904707:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788581206.905617:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.905643:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102144:0@lo:101: 00010000:00010000:2.0:1788581206.905660:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.905670:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.905731:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102272:0@lo:501: 00000100:00100000:2.0:1788581206.905774:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.905787:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.905858:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102272 00000100:00100000:0.0:1788581206.905864:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102272 00000100:00100000:0.0:1788581206.905902:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788581206.905911:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102272:12345-0@lo:501: 00000100:00100000:0.0:1788581206.906044:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102272:12345-0@lo:501: Request processed in 134us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.906051:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788581206.906080:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102272:0@lo:501: 00000100:00100000:0.0:1788581206.906104:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102400:0@lo:503: 00000100:00100000:0.0:1788581206.906141:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.906160:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.906186:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102400 00000100:00100000:0.0:1788581206.906190:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102400 00000100:00100000:0.0:1788581206.906221:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788581206.906227:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102400:12345-0@lo:503: 00000100:00100000:0.0:1788581206.906614:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102400:12345-0@lo:503: Request processed in 385us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.906621:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000004:00080000:1.0:1788581206.907287:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788581206.909792:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102400:0@lo:503: 00000100:00100000:2.0:1788581206.910664:0:9947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9947:1875463184102528:0@lo:502: 00000100:00100000:2.0:1788581206.910736:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.910782:0:9947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.912117:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102528 00000100:00100000:3.0:1788581206.912127:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102528 00000100:00100000:3.0:1788581206.912432:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788581206.912443:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:9947:x1875463184102528:12345-0@lo:502: 00000100:00100000:3.0:1788581206.912593:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:9947:x1875463184102528:12345-0@lo:502: Request processed in 152us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.912601:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788581206.912681:0:9947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9947:1875463184102528:0@lo:502: 00000100:00100000:2.0:1788581206.912741:0:9947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9947:1875463184102656:0@lo:502: 00000100:00100000:2.0:1788581206.912782:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.912808:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102656 00000100:00100000:2.0:1788581206.912812:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102656 00000100:00100000:2.0:1788581206.912836:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788581206.912842:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:9947:x1875463184102656:12345-0@lo:502: 00000100:00100000:2.0:1788581206.912911:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:9947:x1875463184102656:12345-0@lo:502: Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.912918:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788581206.912955:0:9947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.912967:0:9947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9947:1875463184102656:0@lo:502: 00000040:00080000:2.0:1788581206.912985:0:9947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788581206.913439:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788581206.913462:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581206.913471:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913482:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581206.913503:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581206.913505:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3a800 from 6 10000000:01000000:2.0:1788581206.913508:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581206.913532:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913540:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913549:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.913563:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102784:0@lo:101: 00000100:00100000:2.0:1788581206.913595:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.913616:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.913629:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102784 00000100:00100000:2.0:1788581206.913632:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102784 00000100:00100000:2.0:1788581206.913656:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788581206.913662:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184102784:12345-0@lo:101: 00010000:00010000:2.0:1788581206.913672:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581206.913683:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b2faf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2faec expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913702:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b2faf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2faec expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913711:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b2faf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2faec expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913730:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ec00, rc 0) 00000100:00100000:2.0:1788581206.913761:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184102784:12345-0@lo:101: Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.913767:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788581206.913789:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102784:0@lo:101: 00010000:00010000:2.0:1788581206.913801:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.913810:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.913844:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102912:0@lo:256: 00000100:00100000:2.0:1788581206.913869:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.913876:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.913888:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184102912 00000100:00100000:2.0:1788581206.913891:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184102912 00000100:00100000:2.0:1788581206.913907:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788581206.913912:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184102912:12345-0@lo:256: 20000000:01000000:2.0:1788581206.913924:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788581206.913939:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788581206.913941:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788581206.914017:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184102912:12345-0@lo:256: Request processed in 103us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.914023:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788581206.914047:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184102912:0@lo:256: 10000000:01000000:2.0:1788581206.914082:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581206.914090:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.914097:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581206.914104:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788581206.914105:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788581206.914107:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581206.914119:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.914126:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.914133:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.914142:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103040:0@lo:101: 00000100:00100000:2.0:1788581206.914162:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:3.0:1788581206.914948:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788581206.915666:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.915688:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103040 00000100:00100000:2.0:1788581206.915694:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103040 00000100:00100000:2.0:1788581206.915738:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788581206.915747:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184103040:12345-0@lo:101: 00010000:00010000:2.0:1788581206.915759:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581206.915789:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fafa expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.915812:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.915829:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.915838:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:2.0:1788581206.915887:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103040:12345-0@lo:101: Request processed in 141us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.915893:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788581206.915935:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103040:0@lo:101: 00010000:00010000:2.0:1788581206.915950:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.915959:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.916036:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103168:0@lo:501: 00000100:00100000:2.0:1788581206.916066:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.916080:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.916091:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103168 00000100:00100000:2.0:1788581206.916094:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103168 00000100:00100000:2.0:1788581206.916110:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788581206.916115:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103168:12345-0@lo:501: 00000100:00100000:2.0:1788581206.917443:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103168:12345-0@lo:501: Request processed in 1322us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.917453:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788581206.917501:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103168:0@lo:501: 00000100:00100000:2.0:1788581206.917539:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103296:0@lo:503: 00000100:00100000:2.0:1788581206.917590:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.917614:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.917627:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103296 00000100:00100000:2.0:1788581206.917632:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103296 00000100:00100000:2.0:1788581206.917652:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788581206.917658:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103296:12345-0@lo:503: 00000100:00100000:2.0:1788581206.917736:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103296:12345-0@lo:503: Request processed in 77us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.917743:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788581206.917777:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103296:0@lo:503: 00000100:00100000:1.0:1788581206.920959:0:9951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9951:1875463184103424:0@lo:502: 00000100:00100000:1.0:1788581206.921042:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.921068:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103424 00000100:00100000:2.0:1788581206.921074:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103424 00000100:00100000:1.0:1788581206.921080:0:9951:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.921113:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788581206.921121:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:9951:x1875463184103424:12345-0@lo:502: 00000100:00100000:2.0:1788581206.921553:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:9951:x1875463184103424:12345-0@lo:502: Request processed in 431us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.921562:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788581206.924311:0:9951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9951:1875463184103424:0@lo:502: 00000020:01000000:1.0:1788581206.924391:0:9951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581206.924398:0:9951:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788581206.924417:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581206.924419:0:9951:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788581206.924425:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581206.924429:0:9951:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1788581206.924481:0:9951:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788581206.924485:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581206.924510:0:9951:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff995d42c03370) 00000020:00000080:1.0:1788581206.924549:0:9951:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788581206.924556:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581206.924660:0:9951:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788581206.924666:0:9951:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788581206.924673:0:9951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b2fb0f 00010000:00080000:1.0:1788581206.924706:0:9951:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d4328e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581206.924948:0:9951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788581206.925119:0:9951:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788581206.925133:0:9951:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581206.925344:0:9951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581206.925459:0:9951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581206.925584:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788581206.925682:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1788581206.926575:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8417:x1875463184102016:12345-0@lo:700: Request processed in 22637us (25639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.926588:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581206.926640:0:8417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4380 x1875463184102016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581206.926655:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8417:1875463184102016:0@lo:700: 40000000:02000000:3.0:1788581206.926679:0:8417:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1788581206.928785:0:9952:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581206.928792:0:9952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788581206.929541:0:9951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581206.929552:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788581206.929600:0:9951:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788581206.929625:0:9951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2fb16 00000100:00080000:2.0:1788581206.929634:0:9951:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581206.929640:0:9951:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995d4328e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581206.929673:0:9951:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d432bfb80 x1875463184103552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581206.929726:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184103552:0@lo:8: 00000100:00100000:1.0:1788581206.929792:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.929867:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103552 00000100:00100000:2.0:1788581206.929874:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103552 00000100:00100000:2.0:1788581206.929909:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581206.929917:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875463184103552:12345-0@lo:8: 00010000:00080000:2.0:1788581206.929942:0:8906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1788581206.929967:0:8906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b2fb1d 00002000:00100000:2.0:1788581206.929980:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff995d42c39000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788581206.929984:0:8906:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788581206.929996:0:8906:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581206.930056:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581206.930078:0:8906:0:(import.c:65:import_set_state_nolock()) ffff995d42c3c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581206.933134:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184103552:12345-0@lo:8: Request processed in 3207us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.933148:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788581206.933183:0:9951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788581206.933338:0:9951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581206.933346:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581206.933348:0:9951:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788581206.933351:0:9951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581206.933355:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581206.933356:0:9951:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581206.933360:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581206.933361:0:9951:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788581206.933400:0:9951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9951:1875463184103680:0@lo:502: 00000100:00100000:2.0:1788581206.933465:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.933491:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103680 00000100:00100000:2.0:1788581206.933498:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103680 00000100:00100000:2.0:1788581206.933534:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581206.933543:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:9951:x1875463184103680:12345-0@lo:502: 00000100:00100000:2.0:1788581206.933663:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:9951:x1875463184103680:12345-0@lo:502: Request processed in 120us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.933676:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581206.933721:0:9951:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.933740:0:9951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:9951:1875463184103680:0@lo:502: 00000020:01000000:2.0:1788581206.933765:0:9951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581206.933769:0:9951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581206.933770:0:9951:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581206.933774:0:9951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788581206.933824:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788581206.933843:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581206.933853:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.933864:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581206.933874:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581206.933876:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7557cd28 from 1 10000000:01000000:2.0:1788581206.933879:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581206.933902:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.933911:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.933919:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.933930:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103808:0@lo:101: 00000100:00100000:2.0:1788581206.933958:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.933984:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.934581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103808 00000100:00100000:3.0:1788581206.934587:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103808 00000100:00100000:3.0:1788581206.934634:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788581206.934641:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184103808:12345-0@lo:101: 00010000:00010000:3.0:1788581206.934652:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581206.934664:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fb24 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.934686:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.934695:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581206.934702:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5200, rc 0) 00000100:00100000:3.0:1788581206.934746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184103808:12345-0@lo:101: Request processed in 105us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.934752:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788581206.934863:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103808:0@lo:101: 00010000:00010000:2.0:1788581206.934877:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.934885:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581206.934933:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103936:0@lo:501: 00000100:00100000:2.0:1788581206.934959:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.934981:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.935005:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184103936 00000100:00100000:2.0:1788581206.935009:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184103936 00000100:00100000:2.0:1788581206.935031:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788581206.935037:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184103936:12345-0@lo:501: 00000100:00100000:2.0:1788581206.935097:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184103936:12345-0@lo:501: Request processed in 59us (137us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581206.935103:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788581206.935129:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184103936:0@lo:501: 10000000:01000000:2.0:1788581206.935148:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581206.935153:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581206.935161:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788581206.940085:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432bfb80 x1875463184103552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.940102:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581206.940113:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788581206.940121:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581206.940126:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788581206.940130:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d4328e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581206.940144:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581206.940151:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184103552:0@lo:8: 00000004:00080000:1.0:1788581206.940185:0:9952:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581206.940274:0:9952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193082018967ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581206.940281:0:9952:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:2.0:1788581206.941199:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788581206.941208:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788581206.941457:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184101888:12345-0@lo:700: Request processed in 40570us (40624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.941468:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581206.941518:0:9946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7b80 x1875463184101888/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581206.941532:0:9946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184101888:0@lo:700: 00000004:00080000:0.0:1788581206.943851:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788581206.947879:0:9946:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788581206.947910:0:9946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104192:0@lo:7: 00000100:00100000:1.0:1788581206.947974:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581206.948023:0:9946:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581206.948037:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184104064:0@lo:13: 00000100:00100000:2.0:1788581206.948045:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104192 00000100:00100000:2.0:1788581206.948053:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104192 00000100:00100000:1.0:1788581206.948061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.948099:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581206.948108:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184104192:12345-0@lo:7: 00000100:00100000:0.0:1788581206.948197:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104064 00000100:00100000:0.0:1788581206.948201:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104064 00000100:00100000:0.0:1788581206.948230:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581206.948236:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875463184104064:12345-0@lo:13: 00002000:00000024:0.0:1788581206.948270:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788581206.948317:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875463184104064:12345-0@lo:13: Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.948323:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788581206.948361:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4700 x1875463184104064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.948390:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184104064:0@lo:13: 00000100:00100000:0.0:1788581206.948715:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581206.948727:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184104320:0@lo:13: 00000100:00100000:0.0:1788581206.948758:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.948782:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104320 00000100:00100000:0.0:1788581206.948786:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104320 00000100:00100000:0.0:1788581206.948815:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581206.948822:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184104320:12345-0@lo:13: 00002000:00000024:0.0:1788581206.948842:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788581206.948872:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184104320:12345-0@lo:13: Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.948879:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788581206.948904:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d42258700 x1875463184104320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.948918:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184104320:0@lo:13: 00000004:00080000:0.0:1788581206.948935:0:9953:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788581206.948952:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104448:0@lo:7: 00000100:00100000:0.0:1788581206.948976:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.949009:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581206.949197:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104448 00000100:00100000:3.0:1788581206.949202:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104448 00000100:00100000:3.0:1788581206.949238:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581206.949245:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9953:x1875463184104448:12345-0@lo:7: 00000100:00080000:3.0:1788581206.951129:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788581206.966658:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788581206.966666:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788581206.966809:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184104192:12345-0@lo:7: Request processed in 18698us (18830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581206.966820:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:0.0:1788581206.967472:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788581206.967476:0:8906:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788581206.967524:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9953:x1875463184104448:12345-0@lo:7: Request processed in 18278us (18544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581206.967532:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788581206.967574:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d42258700 x1875463184104448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.967589:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104448:0@lo:7: 00000004:00080000:0.0:1788581206.967604:0:9953:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00010000:00080000:2.0:1788581206.972275:0:9946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7800 x1875463184104192/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581206.972294:0:9946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104192:0@lo:7: 00000004:00080000:2.0:1788581206.972310:0:9946:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788581206.972352:0:9946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104576:0@lo:5: 00000100:00100000:0.0:1788581206.972584:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104704:0@lo:5: 00000100:00100000:0.0:1788581206.972638:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.972678:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44f61180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.972698:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104704 00000100:00100000:0.0:1788581206.972705:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104704 00000100:00100000:0.0:1788581206.972753:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581206.972770:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9953:x1875463184104704:12345-0@lo:5: 00002000:00080000:0.0:1788581206.972800:0:8410:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788581206.972804:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788581206.973022:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581206.973049:0:9946:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581206.973065:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104576 00000100:00100000:2.0:1788581206.973069:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104576 00000100:00100000:2.0:1788581206.973095:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581206.973102:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184104576:12345-0@lo:5: 00002000:00080000:2.0:1788581206.973114:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788581206.973160:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184104576:12345-0@lo:5: Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581206.973234:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788581206.973511:0:9946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432bf100 x1875463184104576/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581206.973523:0:9946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104576:0@lo:5: 00000004:00080000:1.0:1788581206.973533:0:9946:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788581206.973575:0:9946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104832:0@lo:5: 00000100:00100000:1.0:1788581206.973605:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.974809:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9953:x1875463184104704:12345-0@lo:5: Request processed in 2037us (2166us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788581206.974818:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581206.975656:0:9946:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581206.980528:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104832 00000100:00100000:1.0:1788581206.980543:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104832 00000100:00100000:1.0:1788581206.980600:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581206.980612:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9946:x1875463184104832:12345-0@lo:5: 00002000:00080000:1.0:1788581206.980655:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00080000:0.0:1788581206.981506:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d42258700 x1875463184104704/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.981526:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104704:0@lo:5: 00000004:00080000:0.0:1788581206.981542:0:9953:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788581206.981596:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104960:0@lo:700: 00000100:00100000:0.0:1788581206.981693:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.981731:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44f61180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581206.981752:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184104960 00000100:00100000:0.0:1788581206.981757:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184104960 00000100:00100000:0.0:1788581206.981801:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581206.981811:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9953:x1875463184104960:12345-0@lo:700: 00000100:00100000:1.0:1788581206.982471:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9946:x1875463184104832:12345-0@lo:5: Request processed in 1859us (8862us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788581206.982481:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788581206.982862:0:9946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e6d80 x1875463184104832/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.982876:0:9946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9946:1875463184104832:0@lo:5: 00000004:00080000:0.0:1788581206.982887:0:9946:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788581206.982919:0:9946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9946:1875463184105088:0@lo:900: 00000100:00100000:0.0:1788581206.982958:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581206.982986:0:9946:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44f61d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581206.983154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105088 00000100:00100000:1.0:1788581206.983160:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105088 00000100:00100000:1.0:1788581206.983202:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581206.983210:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9946:x1875463184105088:12345-0@lo:900: 00000100:00100000:1.0:1788581206.983448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9946:x1875463184105088:12345-0@lo:900: Request processed in 238us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.983455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581206.983503:0:9946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c9880 x1875463184105088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.983525:0:9946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9946:1875463184105088:0@lo:900: 00000001:00080000:0.0:1788581206.988689:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1788581206.988706:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788581206.989359:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9953:x1875463184104960:12345-0@lo:700: Request processed in 7546us (7662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.989371:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581206.989596:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432caa00 x1875463184104960/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581206.989610:0:9953:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788581206.989628:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184104960:0@lo:700: 00000004:02000040:0.0:1788581206.995736:0:9953:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788581207.003782:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184105216:0@lo:5: 00000100:00100000:0.0:1788581207.003854:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581207.003908:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44f61180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581207.004570:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105216 00000100:00100000:2.0:1788581207.004592:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105216 00000100:00100000:2.0:1788581207.004650:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581207.004662:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9953:x1875463184105216:12345-0@lo:5: 00002000:00080000:3.0:1788581207.014607:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788581207.014626:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788581207.019232:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9953:x1875463184105216:12345-0@lo:5: Request processed in 14565us (15370us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788581207.019245:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788581207.019351:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432caa00 x1875463184105216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581207.019369:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9953:1875463184105216:0@lo:5: 00000004:00080000:0.0:1788581207.019384:0:9953:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788581207.745850:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581207.873826:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581207.873849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184105344:0@lo:41: 00000100:00100000:2.0:1788581207.873959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581207.874120:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105344 00000100:00100000:3.0:1788581207.874129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105344 00000100:00100000:3.0:1788581207.874176:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788581207.874185:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184105344:12345-0@lo:41: 00000004:00000024:3.0:1788581207.874229:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581207.874301:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184105344:12345-0@lo:41: Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581207.874308:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581207.874390:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184105344:0@lo:41: 00000001:00080000:1.0:1788581208.031717:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1788581208.769567:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581208.869684:0:10011:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581208.869905:0:10011:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788581209.568846:0:10059:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581209.568857:0:10059:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788581209.795327:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581209.921552:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581209.921575:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184105472:0@lo:13: 00000100:00100000:2.0:1788581209.921638:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581209.923537:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105472 00000100:00100000:3.0:1788581209.923550:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105472 00000100:00080000:1.0:1788581209.925398:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581209.925428:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581209.925450:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184105600:0@lo:13: 00000100:00100000:1.0:1788581209.925523:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581209.925806:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105600 00000100:00100000:0.0:1788581209.925814:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105600 00000100:00080000:2.0:1788581209.928607:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581209.928859:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581209.928877:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184105472:12345-0@lo:13: 00002000:00000024:3.0:1788581209.928912:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581209.929005:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184105472:12345-0@lo:13: Request processed in 136us (7366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581209.929012:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788581209.929119:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432bce00 x1875463184105472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581209.929137:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184105472:0@lo:13: 00000100:00100000:0.0:1788581209.930511:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581209.930528:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184105600:12345-0@lo:13: 00002000:00000024:0.0:1788581209.930547:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581209.930608:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184105600:12345-0@lo:13: Request processed in 88us (5084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581209.930615:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788581209.932394:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423af800 x1875463184105600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581209.932420:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184105600:0@lo:13: 00000100:00100000:0.0:1788581210.434154:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581210.434218:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184105728:0@lo:41: 00000100:00100000:0.0:1788581210.434358:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581210.434490:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105728 00000100:00100000:1.0:1788581210.434497:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105728 00000100:00100000:1.0:1788581210.434544:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581210.434554:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184105728:12345-0@lo:41: 00000004:00000024:1.0:1788581210.434598:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788581210.434652:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184105728:12345-0@lo:41: Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581210.434659:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581210.434862:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184105728:0@lo:41: 00010000:00010000:1.0:1788581210.817691:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581210.983900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581210.983988:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425216 00000100:00100000:2.0:1788581210.983998:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425216 00000100:00100000:2.0:1788581210.984047:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:2.0:1788581210.984055:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875463170425216:12345-192.168.203.3@tcp:250: 00010000:00080000:2.0:1788581210.984082:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9dea27fd-4c26-4644-b718-43c4e0969f66@192.168.203.3@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1788581210.984112:0:6487:0:(genops.c:1385:class_connect()) connect: client 9dea27fd-4c26-4644-b718-43c4e0969f66, cookie 0x50f0cc74b7b2fb32 00000100:00080000:2.0:1788581210.984291:0:6487:0:(import.c:65:import_set_state_nolock()) ffff995d42c3b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581210.984356:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+5:2392:x1875463170425216:12345-192.168.203.3@tcp:250: Request processed in 300us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581210.984363:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:0.0:1788581210.987598:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581210.987689:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425088 00000100:00100000:3.0:1788581210.987699:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425088 00000100:00100000:3.0:1788581210.987754:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:3.0:1788581210.987765:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+5:6149:x1875463170425088:12345-192.168.203.3@tcp:101: 00010000:00010000:3.0:1788581210.987956:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581210.987994:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21e66 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581210.988023:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581210.988034:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581210.988044:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4c00, rc 0) 00000100:00100000:3.0:1788581210.988138:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+6:6149:x1875463170425088:12345-192.168.203.3@tcp:101: Request processed in 374us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581210.988145:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:3.0:1788581210.995346:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581210.995506:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425344 00000100:00100000:0.0:1788581210.995516:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425344 00000100:00100000:0.0:1788581210.995564:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1788581210.995574:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+6:6149:x1875463170425344:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1788581210.995759:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+6:6149:x1875463170425344:12345-192.168.203.3@tcp:501: Request processed in 186us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581210.995767:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1788581211.002345:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581211.002774:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425472 00000100:00100000:3.0:1788581211.002784:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425472 00000100:00100000:3.0:1788581211.002836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:3.0:1788581211.002846:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+6:6149:x1875463170425472:12345-192.168.203.3@tcp:101: 00010000:00010000:3.0:1788581211.002862:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581211.002880:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21e6d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581211.002906:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581211.002917:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581211.002926:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4200, rc 0) 00000100:00100000:3.0:1788581211.003010:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+7:6149:x1875463170425472:12345-192.168.203.3@tcp:101: Request processed in 166us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.003017:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:1.0:1788581211.008765:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581211.008857:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425600 00000100:00100000:2.0:1788581211.008867:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425600 00000100:00100000:2.0:1788581211.008921:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1788581211.008931:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+7:6149:x1875463170425600:12345-192.168.203.3@tcp:501: 00000100:00100000:2.0:1788581211.009157:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6149:x1875463170425600:12345-192.168.203.3@tcp:501: Request processed in 226us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.009165:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1788581211.017095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581211.020297:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425728 00000100:00100000:1.0:1788581211.020310:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425728 00000100:00100000:1.0:1788581211.020419:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:1.0:1788581211.020430:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6149:x1875463170425728:12345-192.168.203.3@tcp:503: 00000100:00100000:1.0:1788581211.020579:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6149:x1875463170425728:12345-192.168.203.3@tcp:503: Request processed in 151us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.020586:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:0.0:1788581211.028983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581211.029073:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425856 00000100:00100000:3.0:1788581211.029081:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425856 00000100:00100000:3.0:1788581211.029131:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:3.0:1788581211.029143:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6167:x1875463170425856:12345-192.168.203.3@tcp:502: 00000100:00100000:3.0:1788581211.029417:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6167:x1875463170425856:12345-192.168.203.3@tcp:502: Request processed in 276us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.029425:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1788581211.090362:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581211.090620:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170425984 00000100:00100000:1.0:1788581211.090629:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170425984 00000100:00100000:1.0:1788581211.090684:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:1.0:1788581211.090694:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6167:x1875463170425984:12345-192.168.203.3@tcp:502: 00000100:00100000:1.0:1788581211.090851:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6167:x1875463170425984:12345-192.168.203.3@tcp:502: Request processed in 158us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.090859:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:0.0:1788581211.100021:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581211.100170:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426112 00000100:00100000:2.0:1788581211.100180:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426112 00000100:00100000:2.0:1788581211.100240:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:2.0:1788581211.100278:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6149:x1875463170426112:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1788581211.100296:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581211.100314:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272a00/0x50f0cc74b7b2fb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21e9e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.100341:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272a00/0x50f0cc74b7b2fb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e9e expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.100352:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272a00/0x50f0cc74b7b2fb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e9e expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.100756:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272a00, rc 0) 00000100:00100000:2.0:1788581211.100896:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6149:x1875463170426112:12345-192.168.203.3@tcp:101: Request processed in 645us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.100904:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:0.0:1788581211.109289:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581211.109381:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426240 00000100:00100000:3.0:1788581211.109398:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426240 00000100:00100000:1.0:1788581211.109583:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:1.0:1788581211.109595:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6149:x1875463170426240:12345-192.168.203.3@tcp:256: 20000000:01000000:1.0:1788581211.109620:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788581211.109644:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788581211.109649:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788581211.109652:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788581211.109655:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788581211.109657:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788581211.119229:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6149:x1875463170426240:12345-192.168.203.3@tcp:256: Request processed in 9620us (9961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.119246:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:3.0:1788581211.124950:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581211.127563:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426368 00000100:00100000:2.0:1788581211.127577:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426368 00000100:00100000:2.0:1788581211.128421:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:2.0:1788581211.128439:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6149:x1875463170426368:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1788581211.128457:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581211.128487:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21ea5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.128514:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.128525:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581211.128534:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272400, rc 0) 00000100:00100000:2.0:1788581211.128592:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6149:x1875463170426368:12345-192.168.203.3@tcp:101: Request processed in 161us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.128599:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1788581211.134073:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581211.134219:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426496 00000100:00100000:1.0:1788581211.134229:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426496 00000100:00100000:1.0:1788581211.134551:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:1.0:1788581211.134563:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6149:x1875463170426496:12345-192.168.203.3@tcp:501: 00000100:00100000:1.0:1788581211.135141:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6149:x1875463170426496:12345-192.168.203.3@tcp:501: Request processed in 578us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.135150:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:0.0:1788581211.138769:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581211.138879:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426624 00000100:00100000:3.0:1788581211.138889:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426624 00000100:00100000:3.0:1788581211.138946:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:3.0:1788581211.138956:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6149:x1875463170426624:12345-192.168.203.3@tcp:503: 00000100:00100000:3.0:1788581211.139204:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6149:x1875463170426624:12345-192.168.203.3@tcp:503: Request processed in 248us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.139212:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:3.0:1788581211.145850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581211.146408:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426752 00000100:00100000:1.0:1788581211.146418:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426752 00000100:00100000:1.0:1788581211.146480:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:1.0:1788581211.146490:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6173:x1875463170426752:12345-192.168.203.3@tcp:502: 00000100:00100000:1.0:1788581211.146641:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6173:x1875463170426752:12345-192.168.203.3@tcp:502: Request processed in 152us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.146657:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1788581211.150981:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581211.151058:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170426880 00000100:00100000:3.0:1788581211.151068:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170426880 00000100:00100000:3.0:1788581211.151123:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:3.0:1788581211.151133:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6173:x1875463170426880:12345-192.168.203.3@tcp:502: 00000100:00100000:3.0:1788581211.151322:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6173:x1875463170426880:12345-192.168.203.3@tcp:502: Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.151338:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:0.0:1788581211.158911:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581211.158954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581211.159059:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427008 00000100:00100000:2.0:1788581211.159069:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427008 00000100:00100000:2.0:1788581211.159110:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427264 00000100:00100000:2.0:1788581211.159113:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427264 00000100:00100000:2.0:1788581211.159210:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1788581211.159219:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581211.159220:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875463170427008:12345-192.168.203.3@tcp:38: 00000100:00100000:3.0:1788581211.159225:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875463170427264:12345-192.168.203.3@tcp:38: 00010000:00080000:3.0:1788581211.159247:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 197 last 0 00010000:00080000:2.0:1788581211.159248:0:9504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1788581211.159329:0:9504:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2fb55 00000004:00100000:2.0:1788581211.159352:0:9504:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788581211.159487:0:6493:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2fb5c 00000004:00100000:3.0:1788581211.159501:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788581211.159618:0:9504:0:(import.c:65:import_set_state_nolock()) ffff995d42c3e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581211.159686:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170427008:12345-192.168.203.3@tcp:38: Request processed in 464us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.159694:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00080000:2.0:1788581211.159902:0:6493:0:(import.c:65:import_set_state_nolock()) ffff995d41e5b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581211.159940:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170427264:12345-192.168.203.3@tcp:38: Request processed in 713us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.159954:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00010000:00010000:1.0:1788581211.841495:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581211.969745:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184106112:0@lo:400: 00000100:00100000:1.0:1788581211.969816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581211.969895:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106112 00000100:00100000:1.0:1788581211.969903:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106112 00000100:00100000:1.0:1788581211.969944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581211.969952:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184106112:12345-0@lo:400: 00000100:00100000:1.0:1788581211.970020:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184106112:12345-0@lo:400: Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.970027:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581211.970066:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184106112:0@lo:400: 00000100:00100000:2.0:1788581211.970350:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184105856:0@lo:400: 00000100:00100000:2.0:1788581211.970383:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.970414:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581211.970419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184105984:0@lo:400: 00000100:00100000:2.0:1788581211.970444:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.970469:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105984 00000100:00100000:2.0:1788581211.970472:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105984 00000100:00100000:2.0:1788581211.970509:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581211.970516:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184105984:12345-0@lo:400: 00000100:00100000:2.0:1788581211.970552:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184105984:12345-0@lo:400: Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.970558:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788581211.970587:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ad500 x1875463184105984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581211.970599:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184105984:0@lo:400: 00000100:00100000:3.0:1788581211.972931:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184106624:0@lo:400: 00000100:00100000:2.0:1788581211.973943:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184106240:0@lo:400: 00000100:00100000:0.0:1788581211.974135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184106496:0@lo:400: 00000100:00100000:1.0:1788581211.974291:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184105856 00000100:00100000:1.0:1788581211.974299:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184105856 00000100:00100000:1.0:1788581211.974353:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788581211.974363:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184105856:12345-0@lo:400: 00000100:00100000:2.0:1788581211.976561:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.976609:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184106752:0@lo:400: 00000100:00100000:2.0:1788581211.976640:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.976706:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184107264:0@lo:400: 00000100:00100000:2.0:1788581211.976730:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.976756:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581211.976763:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184107648:0@lo:13: 00000100:00100000:2.0:1788581211.976805:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.976849:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106752 00000100:00100000:2.0:1788581211.977207:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106752 00000100:00100000:3.0:1788581211.977306:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581211.977306:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107264 00000100:00100000:2.0:1788581211.977311:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107264 00000100:00100000:3.0:1788581211.977340:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184107136:0@lo:400: 00000100:00100000:2.0:1788581211.977350:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581211.977361:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184106752:12345-0@lo:400: 00000100:00100000:2.0:1788581211.977414:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184106752:12345-0@lo:400: Request processed in 55us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.977420:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581211.977437:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581211.977443:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184107264:12345-0@lo:400: 00000100:00100000:2.0:1788581211.977471:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184107264:12345-0@lo:400: Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.977477:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581211.977502:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581211.977506:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581211.977511:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581211.977526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106240 00000100:00100000:2.0:1788581211.977530:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106240 00000100:00100000:2.0:1788581211.977552:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106624 00000100:00100000:2.0:1788581211.977554:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106624 00000100:00100000:2.0:1788581211.977567:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107136 00000100:00100000:2.0:1788581211.977569:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107136 00000100:00100000:2.0:1788581211.977581:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581211.977586:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184106240:12345-0@lo:400: 00000100:00100000:2.0:1788581211.977613:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184106240:12345-0@lo:400: Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.977619:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581211.977628:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581211.977642:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184106624:12345-0@lo:400: 00000100:00100000:3.0:1788581211.977670:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581211.977681:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184107136:12345-0@lo:400: 00000100:00100000:2.0:1788581211.977687:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184106624:12345-0@lo:400: Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.977695:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788581211.977717:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581211.977725:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184107136:12345-0@lo:400: Request processed in 45us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.977734:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184106368:0@lo:400: 00000100:00100000:3.0:1788581211.977735:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788581211.977774:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423aea00 x1875463184106624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581211.977788:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184106624:0@lo:400: 00010000:00080000:3.0:1788581211.977798:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ac700 x1875463184107136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581211.977806:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184107136:0@lo:400: 00000100:00100000:3.0:1788581211.977854:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107648 00000100:00100000:3.0:1788581211.977858:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107648 00000100:00100000:3.0:1788581211.977889:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581211.977894:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184107648:12345-0@lo:13: 00002000:00000024:3.0:1788581211.978045:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581211.978085:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184107648:12345-0@lo:13: Request processed in 190us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.978091:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788581211.978136:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c9180 x1875463184107648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581211.978145:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788581211.978161:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184107648:0@lo:13: 00000100:00100000:2.0:1788581211.978171:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788581211.978176:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423adf80 x1875463184106240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581211.978186:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184106240:0@lo:400: 00000100:00100000:2.0:1788581211.978198:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184106880:0@lo:400: 00010000:00080000:3.0:1788581211.978202:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ad500 x1875463184106752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581211.978212:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184106752:0@lo:400: 00010000:00080000:3.0:1788581211.978225:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ac380 x1875463184107264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581211.978230:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581211.978238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184107264:0@lo:400: 00000100:00100000:3.0:1788581211.978366:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106368 00000100:00100000:3.0:1788581211.978371:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106368 00000100:00100000:3.0:1788581211.978477:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581211.978484:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184106368:12345-0@lo:400: 00000100:00100000:3.0:1788581211.978517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184106368:12345-0@lo:400: Request processed in 33us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.978530:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581211.978715:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184107392:0@lo:400: 00000100:00100000:3.0:1788581211.978737:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106880 00000100:00100000:3.0:1788581211.978743:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106880 00000100:00100000:2.0:1788581211.978757:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581211.978790:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107392 00000100:00100000:3.0:1788581211.978794:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107392 00000100:00100000:2.0:1788581211.978798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184106368:0@lo:400: 00000100:00100000:3.0:1788581211.978823:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581211.978830:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581211.978833:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184106880:12345-0@lo:400: 00000100:00100000:2.0:1788581211.978843:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184107392:12345-0@lo:400: 00000100:00100000:3.0:1788581211.978877:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184106880:12345-0@lo:400: Request processed in 47us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.978885:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581211.978897:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184107392:12345-0@lo:400: Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.978905:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788581211.978926:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581211.978932:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581211.978939:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423aed80 x1875463184106880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581211.978950:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184106880:0@lo:400: 00010000:00080000:2.0:1788581211.979039:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423afb80 x1875463184107392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581211.979047:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788581211.979056:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184107392:0@lo:400: 00000100:00100000:0.0:1788581211.980856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581211.980950:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184107008:0@lo:400: 00000100:00100000:0.0:1788581211.981016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581211.981734:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184107520:0@lo:13: 00000100:00100000:0.0:1788581211.981769:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581211.981811:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107520 00000100:00100000:0.0:1788581211.981819:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107520 00000100:00100000:0.0:1788581211.981865:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581211.981875:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184107520:12345-0@lo:13: 00002000:00000024:0.0:1788581211.981900:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581211.981943:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184107520:12345-0@lo:13: Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581211.981950:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788581211.982005:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c8380 x1875463184107520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581211.982027:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184107520:0@lo:13: 00000100:00100000:2.0:1788581211.982357:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184106496 00000100:00100000:2.0:1788581211.982363:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184106496 00000100:00100000:2.0:1788581211.982408:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107008 00000100:00100000:2.0:1788581211.982412:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107008 00000100:00100000:2.0:1788581211.982436:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581211.982443:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184106496:12345-0@lo:400: 00000100:00100000:2.0:1788581211.982490:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184106496:12345-0@lo:400: Request processed in 48us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.982497:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581211.982511:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581211.982518:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184107008:12345-0@lo:400: 00000100:00100000:2.0:1788581211.982544:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184107008:12345-0@lo:400: Request processed in 27us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.982550:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788581211.982571:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788581211.982784:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ae680 x1875463184106496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581211.982796:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184106496:0@lo:400: 00010000:00080000:0.0:1788581211.982805:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423af800 x1875463184107008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581211.982812:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184107008:0@lo:400: 00000100:00100000:1.0:1788581211.984435:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184105856:12345-0@lo:400: Request processed in 10065us (14042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.984449:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788581211.984724:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184105856:0@lo:400: 00000100:00100000:0.0:1788581212.174615:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581212.174702:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427392 00000100:00100000:2.0:1788581212.174712:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427392 00000100:00100000:2.0:1788581212.174790:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1788581212.174800:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170427392:12345-192.168.203.3@tcp:41: 00000004:00000024:2.0:1788581212.174836:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581212.174953:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170427392:12345-192.168.203.3@tcp:41: Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.174969:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00080000:3.0:1788581212.175878:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581212.176944:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581212.176987:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581212.177124:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427520 00000100:00100000:3.0:1788581212.177141:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427520 00000100:00100000:3.0:1788581212.177202:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427136 00000100:00100000:3.0:1788581212.177206:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427136 00000100:00100000:3.0:1788581212.177232:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581212.177242:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:6149:x1875463170427520:12345-192.168.203.3@tcp:41: 00000004:00000024:3.0:1788581212.177294:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788581212.177349:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:6149:x1875463170427520:12345-192.168.203.3@tcp:41: Request processed in 108us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581212.177356:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581212.177372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1788581212.177379:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170427136:12345-192.168.203.3@tcp:41: 00000100:00080000:0.0:1788581212.177458:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788581212.177821:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788581212.177867:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170427136:12345-192.168.203.3@tcp:41: Request processed in 487us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581212.177888:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581212.180820:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581212.180913:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427648 00000100:00100000:2.0:1788581212.180922:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427648 00000100:00100000:2.0:1788581212.181005:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:2.0:1788581212.181021:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170427648:12345-192.168.203.3@tcp:40: 00000100:00100000:2.0:1788581212.181094:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170427648:12345-192.168.203.3@tcp:40: Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.181101:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1788581212.193878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581212.193930:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581212.193965:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581212.193994:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581212.194084:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427776 00000100:00100000:3.0:1788581212.194094:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427776 00000100:00100000:3.0:1788581212.194140:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170427904 00000100:00100000:3.0:1788581212.194144:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170427904 00000100:00100000:3.0:1788581212.194162:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581212.194171:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875463170427776:12345-192.168.203.3@tcp:8: 00010000:00080000:3.0:1788581212.194199:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788581212.194229:0:8409:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2fb63 00002000:00100000:3.0:1788581212.194239:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36c1c238-f3ab-41d9-b90e-c3af2be29807/ffff995e7fa4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581212.194271:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581212.194465:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581212.194494:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581212.194554:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170427776:12345-192.168.203.3@tcp:8: Request processed in 382us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581212.194561:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581212.194577:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581212.194582:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875463170427904:12345-192.168.203.3@tcp:8: 00010000:00080000:3.0:1788581212.194598:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788581212.194615:0:8409:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2fb6a 00002000:00100000:3.0:1788581212.194620:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36c1c238-f3ab-41d9-b90e-c3af2be29807/ffff995e7fa4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581212.194626:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581212.194785:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581212.194800:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581212.194840:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170427904:12345-192.168.203.3@tcp:8: Request processed in 255us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581212.194848:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1788581212.195090:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428032 00000100:00100000:2.0:1788581212.195096:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428032 00000100:00100000:2.0:1788581212.195138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1788581212.195146:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170428032:12345-192.168.203.3@tcp:900: 00000100:00100000:2.0:1788581212.195186:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170428032:12345-192.168.203.3@tcp:900: Request processed in 41us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.195192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1788581212.195212:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428160 00000100:00100000:2.0:1788581212.195216:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428160 00000100:00100000:2.0:1788581212.195243:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:2.0:1788581212.195250:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170428160:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581212.195305:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170428160:12345-192.168.203.3@tcp:400: Request processed in 57us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.195311:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:0.0:1788581212.198062:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581212.198276:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428288 00000100:00100000:1.0:1788581212.198284:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428288 00000100:00100000:1.0:1788581212.198328:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1788581212.198337:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170428288:12345-192.168.203.3@tcp:33: 00000004:00080000:2.0:1788581212.224011:0:6496:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25580us 00000004:00200000:2.0:1788581212.237808:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788581212.238551:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6149:x1875463170428288:12345-192.168.203.3@tcp:33: Request processed in 40208us (40489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.238566:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581212.406343:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581212.406487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428416 00000100:00100000:1.0:1788581212.406497:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428416 00000100:00100000:1.0:1788581212.406561:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581212.406583:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6191:x1875463170428416:12345-192.168.203.3@tcp:101: 00010000:00010000:1.0:1788581212.406605:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581212.407007:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b2fb71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21ed6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581212.407198:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581212.407212:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581212.407227:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581212.408490:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788581212.408497:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581212.408518:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581212.408566:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b2fb71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ed6 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581212.408587:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ed6 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581212.408596:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659c00) 00010000:00010000:2.0:1788581212.408599:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581212.408602:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6bc00, rc 0) 00000100:00100000:2.0:1788581212.408925:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:6191:x1875463170428416:12345-192.168.203.3@tcp:101: Request processed in 2343us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.408942:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00010000:00010000:1.0:1788581212.865481:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581212.994838:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581212.994864:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184107776:0@lo:41: 00000100:00100000:0.0:1788581212.994934:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581212.994975:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107776 00000100:00100000:2.0:1788581212.994984:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107776 00000100:00100000:2.0:1788581212.995034:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788581212.995044:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184107776:12345-0@lo:41: 00000004:00000024:2.0:1788581212.995076:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581212.995136:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184107776:12345-0@lo:41: Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581212.995143:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581212.995652:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184107776:0@lo:41: 00010000:00010000:1.0:1788581213.890865:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581214.341729:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581214.341818:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428544 00000100:00100000:3.0:1788581214.341828:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428544 00000100:00100000:3.0:1788581214.341902:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1788581214.341912:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:6244:x1875463170428544:12345-192.168.203.3@tcp:41: 00000004:00000024:3.0:1788581214.341968:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788581214.342049:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:6244:x1875463170428544:12345-192.168.203.3@tcp:41: Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581214.342057:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:0.0:1788581214.342115:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581214.345450:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581214.345538:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428672 00000100:00100000:2.0:1788581214.345548:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428672 00000100:00100000:2.0:1788581214.345626:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1788581214.345637:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428672:12345-192.168.203.3@tcp:41: 00000004:00000024:2.0:1788581214.345673:0:9504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581214.345738:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428672:12345-192.168.203.3@tcp:41: Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581214.345757:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:0.0:1788581214.346422:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581214.351175:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581214.351330:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428800 00000100:00100000:0.0:1788581214.351340:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428800 00000100:00100000:0.0:1788581214.351597:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1788581214.351619:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428800:12345-192.168.203.3@tcp:13: 00002000:00000024:0.0:1788581214.351652:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581214.351722:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428800:12345-192.168.203.3@tcp:13: Request processed in 105us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581214.351729:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:3.0:1788581214.351774:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581214.355352:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581214.355441:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170428928 00000100:00100000:0.0:1788581214.355450:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170428928 00000100:00100000:0.0:1788581214.355560:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1788581214.355570:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428928:12345-192.168.203.3@tcp:13: 00002000:00000024:0.0:1788581214.355599:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581214.355688:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:6244:x1875463170428928:12345-192.168.203.3@tcp:13: Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581214.355695:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:3.0:1788581214.356175:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788581214.914836:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581215.043436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581215.043460:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184107904:0@lo:13: 00000100:00100000:0.0:1788581215.043528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581215.043565:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184107904 00000100:00100000:1.0:1788581215.043572:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184107904 00000100:00100000:1.0:1788581215.043637:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581215.043647:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184107904:12345-0@lo:13: 00002000:00000024:1.0:1788581215.043669:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581215.043710:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184107904:12345-0@lo:13: Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581215.043716:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788581215.044114:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581215.044243:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ad500 x1875463184107904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581215.044284:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184107904:0@lo:13: 00000100:00100000:2.0:1788581215.045683:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581215.045702:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184108032:0@lo:13: 00000100:00100000:2.0:1788581215.045760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581215.046047:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108032 00000100:00100000:1.0:1788581215.046055:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108032 00000100:00080000:0.0:1788581215.046593:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581215.047476:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581215.047503:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184108032:12345-0@lo:13: 00002000:00000024:1.0:1788581215.047530:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581215.047603:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184108032:12345-0@lo:13: Request processed in 104us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581215.047610:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788581215.048011:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e6300 x1875463184108032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581215.048032:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184108032:0@lo:13: 00000100:00100000:0.0:1788581215.553804:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184108160:0@lo:41: 00000100:00100000:0.0:1788581215.553876:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581215.555151:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108160 00000100:00100000:3.0:1788581215.555163:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108160 00000100:00100000:3.0:1788581215.555327:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788581215.555339:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184108160:12345-0@lo:41: 00000004:00000024:3.0:1788581215.555482:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788581215.555562:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184108160:12345-0@lo:41: Request processed in 225us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.555570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581215.555654:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184108160:0@lo:41: 00010000:00010000:1.0:1788581215.937555:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788581216.073149:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:00100000:0.0:1788581216.581056:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:00100000:0.0:1788581216.581995:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:02000400:0.0:1788581216.675539:0:10157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788581216.961509:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581217.089692:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581217.089716:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184108288:0@lo:13: 00000100:00100000:3.0:1788581217.089794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581217.089882:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108288 00000100:00100000:3.0:1788581217.089890:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108288 00000100:00100000:3.0:1788581217.089957:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581217.089968:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184108288:12345-0@lo:13: 00002000:00000024:3.0:1788581217.089996:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581217.090042:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184108288:12345-0@lo:13: Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581217.090049:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788581217.090069:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581217.090098:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b131180 x1875463184108288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581217.090115:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184108288:0@lo:13: 00000100:00100000:2.0:1788581217.090305:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184108800:0@lo:400: 00000100:00100000:2.0:1788581217.090337:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581217.090357:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184109312:0@lo:400: 00000100:00100000:2.0:1788581217.090378:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581217.090391:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184109824:0@lo:400: 00000100:00100000:2.0:1788581217.090408:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581217.090426:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788581217.090431:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184108672:0@lo:400: 00000100:00100000:2.0:1788581217.090455:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581217.090484:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184108416:0@lo:400: 00000100:00100000:0.0:1788581217.090555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184108544:0@lo:400: 00000100:00100000:0.0:1788581217.090585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581217.090605:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184109056:0@lo:400: 00000100:00100000:0.0:1788581217.090623:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581217.090636:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184109568:0@lo:400: 00000100:00100000:0.0:1788581217.090653:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581217.090668:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581217.090672:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184109952:0@lo:13: 00000100:00100000:0.0:1788581217.090705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581217.090744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108800 00000100:00100000:0.0:1788581217.090748:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108800 00000100:00100000:0.0:1788581217.090769:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108544 00000100:00100000:0.0:1788581217.090771:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108544 00000100:00100000:0.0:1788581217.090779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109056 00000100:00100000:0.0:1788581217.090781:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109056 00000100:00100000:0.0:1788581217.090796:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109568 00000100:00100000:0.0:1788581217.090798:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109568 00000100:00100000:0.0:1788581217.090811:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581217.090816:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184108800:12345-0@lo:400: 00000100:00100000:0.0:1788581217.090848:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184108800:12345-0@lo:400: Request processed in 32us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.090854:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581217.090865:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581217.090869:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184108544:12345-0@lo:400: 00000100:00100000:0.0:1788581217.090896:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184108544:12345-0@lo:400: Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.090901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581217.090911:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581217.090917:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184109056:12345-0@lo:400: 00000100:00100000:0.0:1788581217.090954:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184109056:12345-0@lo:400: Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.090960:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581217.090972:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581217.090977:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184109568:12345-0@lo:400: 00000100:00100000:0.0:1788581217.091000:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184109568:12345-0@lo:400: Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.091013:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581217.091032:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109312 00000100:00100000:0.0:1788581217.091035:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109312 00000100:00100000:0.0:1788581217.091058:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109824 00000100:00100000:0.0:1788581217.091061:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109824 00000100:00100000:0.0:1788581217.091079:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581217.091084:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184109312:12345-0@lo:400: 00000100:00100000:0.0:1788581217.091113:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184109312:12345-0@lo:400: Request processed in 29us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.091119:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581217.091129:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581217.091135:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184109824:12345-0@lo:400: 00000100:00100000:0.0:1788581217.091175:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184109824:12345-0@lo:400: Request processed in 40us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.091181:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788581217.091206:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581217.091209:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581217.091211:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581217.091232:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184108544:0@lo:400: 00000100:00100000:0.0:1788581217.091242:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184109056:0@lo:400: 00000100:00100000:0.0:1788581217.091250:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184109568:0@lo:400: 00000100:00100000:0.0:1788581217.091309:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109952 00000100:00100000:0.0:1788581217.091313:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109952 00000100:00100000:0.0:1788581217.091334:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581217.091340:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184109952:12345-0@lo:13: 00002000:00000024:0.0:1788581217.091350:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581217.091389:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184109952:12345-0@lo:13: Request processed in 49us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.091395:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788581217.091421:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b130e00 x1875463184109952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581217.091434:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184109952:0@lo:13: 00000100:00100000:3.0:1788581217.091537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581217.091573:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184108928:0@lo:400: 00000100:00100000:0.0:1788581217.091640:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108416 00000100:00100000:0.0:1788581217.091645:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108416 00000100:00100000:0.0:1788581217.091676:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788581217.091682:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184108416:12345-0@lo:400: 00000100:00100000:0.0:1788581217.091715:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184108416:12345-0@lo:400: Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.091721:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788581217.092055:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184109184:0@lo:400: 00000100:00100000:3.0:1788581217.092082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581217.092082:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581217.092104:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184109696:0@lo:400: 00000100:00100000:0.0:1788581217.092120:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109184 00000100:00100000:0.0:1788581217.092124:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109184 00000100:00100000:2.0:1788581217.092134:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581217.092150:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109696 00000100:00100000:0.0:1788581217.092153:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109696 00010000:00080000:2.0:1788581217.092156:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e10a80 x1875463184109312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581217.092166:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184109312:0@lo:400: 00000100:00100000:0.0:1788581217.092168:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581217.092173:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184109184:12345-0@lo:400: 00010000:00080000:2.0:1788581217.092176:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a5180 x1875463184109824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581217.092183:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184109824:0@lo:400: 00000100:00100000:2.0:1788581217.092194:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184108800:0@lo:400: 00000100:00100000:0.0:1788581217.092203:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184109184:12345-0@lo:400: Request processed in 30us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.092209:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581217.092220:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581217.092226:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184109696:12345-0@lo:400: 00000100:00100000:0.0:1788581217.092249:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184109696:12345-0@lo:400: Request processed in 24us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.092271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788581217.092296:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788581217.092361:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e10380 x1875463184109184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581217.092371:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184109184:0@lo:400: 00010000:00080000:2.0:1788581217.092380:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7b80 x1875463184109696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581217.092387:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184109696:0@lo:400: 00000100:00100000:3.0:1788581217.093070:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184109440:0@lo:400: 00000100:00100000:3.0:1788581217.093103:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581217.093130:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184108416:0@lo:400: 00000100:00100000:0.0:1788581217.093192:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184109440 00000100:00100000:0.0:1788581217.093198:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184109440 00000100:00100000:0.0:1788581217.093240:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581217.093246:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184109440:12345-0@lo:400: 00000100:00100000:0.0:1788581217.093300:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184109440:12345-0@lo:400: Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581217.093306:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788581217.093373:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581217.093392:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a7100 x1875463184109440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581217.093403:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184109440:0@lo:400: 00000100:00100000:1.0:1788581217.096372:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108672 00000100:00100000:1.0:1788581217.096387:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108672 00000100:00100000:1.0:1788581217.096528:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184108928 00000100:00100000:1.0:1788581217.096533:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184108928 00000100:00100000:2.0:1788581217.097878:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581217.097898:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184108672:12345-0@lo:400: 00000100:00100000:2.0:1788581217.098005:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184108672:12345-0@lo:400: Request processed in 116us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.098013:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581217.098031:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581217.098037:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184108928:12345-0@lo:400: 00000100:00100000:2.0:1788581217.098075:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184108928:12345-0@lo:400: Request processed in 39us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.098081:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581217.098320:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184108672:0@lo:400: 00000100:00100000:0.0:1788581217.098377:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184108928:0@lo:400: 00000100:00100000:2.0:1788581217.520649:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581217.520691:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581217.520723:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581217.520749:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581217.520788:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581217.520820:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429056 00000100:00100000:2.0:1788581217.520830:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429056 00000100:00100000:2.0:1788581217.520882:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:2.0:1788581217.520895:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170429056:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581217.520985:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170429056:12345-192.168.203.3@tcp:400: Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.520993:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:2.0:1788581217.521028:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429312 00000100:00100000:2.0:1788581217.521032:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429312 00000100:00100000:2.0:1788581217.521072:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429184 00000100:00100000:2.0:1788581217.521076:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429184 00000100:00100000:2.0:1788581217.521101:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1788581217.521108:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170429312:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581217.521158:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170429312:12345-192.168.203.3@tcp:400: Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.521165:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1788581217.521178:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1788581217.521185:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170429184:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581217.521210:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170429184:12345-192.168.203.3@tcp:400: Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.521217:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1788581217.521234:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429568 00000100:00100000:2.0:1788581217.521238:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429568 00000100:00100000:2.0:1788581217.521289:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429440 00000100:00100000:2.0:1788581217.521292:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429440 00000100:00100000:2.0:1788581217.521318:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1788581217.521325:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170429568:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581217.521355:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170429568:12345-192.168.203.3@tcp:400: Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.521361:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1788581217.521383:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1788581217.521390:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170429440:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1788581217.521419:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170429440:12345-192.168.203.3@tcp:400: Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581217.521424:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00080000:2.0:1788581217.521599:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581217.521603:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581217.521606:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581217.521609:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1788581217.619131:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00010000:00010000:3.0:1788581217.985862:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581218.113581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184110080:0@lo:41: 00000100:00100000:0.0:1788581218.113664:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581218.113728:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110080 00000100:00100000:2.0:1788581218.113736:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110080 00000100:00100000:2.0:1788581218.113799:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581218.113809:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184110080:12345-0@lo:41: 00000004:00000024:2.0:1788581218.113844:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581218.113904:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184110080:12345-0@lo:41: Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581218.113912:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581218.114014:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184110080:0@lo:41: 00010000:00010000:1.0:1788581219.011032:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581219.623891:0:10305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff979d17a0 20000000:00000080:0.0:1788581219.623917:0:10305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e7fa5b400 uarg=0000000000000000 20000000:01000000:0.0:1788581219.623960:0:10305:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788581219.623963:0:10305:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788581219.623965:0:10305:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788581219.623969:0:10305:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788581219.623974:0:10305:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788581219.624025:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788581219.624028:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788581219.624540:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788581219.624686:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788581219.624721:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788581219.624730:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788581219.624736:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788581219.624738:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788581219.625230:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788581219.625669:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788581219.625695:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788581219.625712:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788581219.625725:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788581219.625727:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788581219.626092:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788581219.626687:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788581219.626723:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788581219.626741:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788581219.626753:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788581219.626755:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788581219.627141:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788581219.627971:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788581219.627989:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788581219.627998:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788581219.628005:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788581219.628007:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788581219.629001:0:10310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788581219.630098:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788581219.630248:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788581219.630344:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:3.0:1788581219.630364:0:10305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788581219.630384:0:10305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630401:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630410:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630417:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630424:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630430:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630437:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630443:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630468:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630473:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630482:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630488:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630494:0:10305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630534:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.630549:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 9 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.630562:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110208:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581219.630829:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.631021:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 9 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.631488:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110336:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581219.631561:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.631570:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 23 pid: 6488 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.631579:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110464:0@lo:104: 00000100:00100000:3.0:1788581219.631616:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581219.631662:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.631671:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 23 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.631679:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110592:0@lo:104: 00000100:00100000:0.0:1788581219.631689:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110464 00000100:00100000:0.0:1788581219.631697:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110464 00000100:00100000:0.0:1788581219.631752:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581219.631761:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110464:12345-0@lo:104: 00010000:00010000:0.0:1788581219.631773:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.631799:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581219.631819:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.631825:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788581219.631831:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 23 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.631831:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110464:12345-0@lo:104: Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581219.631839:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110720:0@lo:104: 00000100:00100000:0.0:1788581219.631839:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788581219.631852:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788581219.631853:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110592 00000100:00100000:0.0:1788581219.631856:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110592 00010000:00010000:3.0:1788581219.631857:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.631869:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581219.631874:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110592:12345-0@lo:104: 00010000:00010000:0.0:1788581219.631882:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.631924:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581219.631930:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110592:12345-0@lo:104: Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.631936:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788581219.631947:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581219.631951:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.631967:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581219.631974:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581219.631979:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581219.631984:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581219.632014:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.632021:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788581219.632129:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184110848:0@lo:103: 00000100:00100000:1.0:1788581219.632168:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581219.632206:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110848 00000100:00100000:1.0:1788581219.632210:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110848 00010000:00010000:1.0:1788581219.632228:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581219.632281:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581219.632288:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7143a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184110848:12345-0@lo:103: 00010000:00010000:1.0:1788581219.632309:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581219.632314:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.632323:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.632349:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581219.632384:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7143a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184110848:12345-0@lo:103: Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581219.632389:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581219.632446:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184110848:0@lo:103: 00010000:00010000:3.0:1788581219.632765:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.632775:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b2fb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb2b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.632788:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581219.632790:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581219.632792:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581219.632822:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581219.632854:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.632867:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110720 00000100:00100000:0.0:1788581219.632871:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110720 00010000:00010000:2.0:1788581219.633035:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.633038:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.633040:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581219.633071:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581219.633079:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110720:12345-0@lo:104: 00010000:00010000:0.0:1788581219.633088:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.633138:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581219.633143:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110720:12345-0@lo:104: Request processed in 66us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.633149:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788581219.633184:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581219.633189:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.633195:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581219.633198:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.633211:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581219.633217:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581219.633222:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581219.633244:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.633250:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581219.633282:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.633298:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fae5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.633308:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.633309:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.633311:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581219.633321:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184111104:0@lo:103: 00000100:00100000:2.0:1788581219.633371:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581219.633401:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111104 00000100:00100000:2.0:1788581219.633405:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111104 00010000:00010000:2.0:1788581219.633420:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.633439:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581219.633445:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184111104:12345-0@lo:103: 00010000:00010000:2.0:1788581219.633458:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581219.633462:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634030:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634039:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581219.634042:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634049:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581219.634055:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581219.634060:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581219.634087:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634094:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581219.634141:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.634165:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110976:0@lo:104: 00000100:00100000:3.0:1788581219.634200:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581219.634251:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634273:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b2fafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fb01 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.634284:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581219.634474:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581219.634477:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581219.634489:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184111232:0@lo:103: 00000100:00100000:1.0:1788581219.634518:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581219.634556:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111232 00000100:00100000:1.0:1788581219.634560:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111232 00010000:00010000:1.0:1788581219.634577:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 25 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581219.634598:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581219.634605:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+25:3618:x1875463184111232:12345-0@lo:103: 00010000:00010000:1.0:1788581219.634613:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581219.634617:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 25 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.634700:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581219.634711:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184110976 00000100:00100000:0.0:1788581219.634715:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184110976 00000100:00100000:0.0:1788581219.634735:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581219.634741:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6f96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110976:12345-0@lo:104: 00010000:00010000:0.0:1788581219.634749:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.634787:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581219.634792:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6f96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184110976:12345-0@lo:104: Request processed in 52us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.634798:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788581219.634887:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 25 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.634903:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581219.634952:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+25:3621:x1875463184111104:12345-0@lo:103: Request processed in 1507us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581219.634959:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788581219.635016:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581219.635020:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.635027:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581219.635029:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.635037:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581219.635044:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581219.635049:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581219.635078:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.635085:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788581219.635299:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184111104:0@lo:103: 00010000:00010000:2.0:1788581219.635533:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.635541:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031a00/0x50f0cc74b7b2fab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fabb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.635552:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.635553:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.635555:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581219.635704:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 24 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.637509:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.637526:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 24 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.637541:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111488:0@lo:104: 00000100:00100000:3.0:1788581219.637598:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581219.637632:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1788581219.637652:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.637656:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1788581219.637661:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 24 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.637669:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111616:0@lo:104: 00000100:00100000:2.0:1788581219.637675:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429696 00000100:00100000:2.0:1788581219.637681:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429696 00000100:00100000:3.0:1788581219.637691:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581219.637707:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 10 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.637731:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429824 00000100:00100000:2.0:1788581219.637734:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429824 00010000:00010000:2.0:1788581219.637745:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 11 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.637759:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581219.637766:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2396:x1875463170429696:12345-192.168.203.3@tcp:103: 00010000:00010000:2.0:1788581219.637777:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581219.637781:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 11 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.637792:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 11 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.637809:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581219.637860:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2396:x1875463170429696:12345-192.168.203.3@tcp:103: Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581219.637868:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581219.637885:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1788581219.637891:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170429824:12345-192.168.203.3@tcp:103: 00010000:00010000:2.0:1788581219.637898:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581219.637903:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 10 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.637924:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 10 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.637935:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581219.637946:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.637952:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170429824:12345-192.168.203.3@tcp:103: Request processed in 62us (296us total) trans 0 rc 0/0 00010000:00010000:3.0:1788581219.637955:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581219.637958:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581219.637964:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111744:0@lo:104: 00000100:00100000:3.0:1788581219.637997:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581219.638019:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.638026:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.638033:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111872:0@lo:104: 00000100:00100000:0.0:1788581219.638507:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111488 00000100:00100000:0.0:1788581219.638514:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111488 00000100:00100000:0.0:1788581219.638536:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111616 00000100:00100000:0.0:1788581219.638538:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111616 00000100:00100000:0.0:1788581219.638546:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111744 00000100:00100000:0.0:1788581219.638548:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111744 00000100:00100000:0.0:1788581219.638557:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581219.638563:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:10305:x1875463184111488:12345-0@lo:104: 00010000:00010000:0.0:1788581219.638574:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.638635:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581219.638642:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:10305:x1875463184111488:12345-0@lo:104: Request processed in 78us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.638648:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581219.638663:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581219.638669:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10305:x1875463184111616:12345-0@lo:104: 00010000:00010000:0.0:1788581219.638676:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.638710:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581219.638714:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10305:x1875463184111616:12345-0@lo:104: Request processed in 47us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.638720:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581219.638732:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581219.638737:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184111744:12345-0@lo:104: 00010000:00010000:0.0:1788581219.638743:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.638771:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581219.638777:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184111744:12345-0@lo:104: Request processed in 39us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.638782:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788581219.638954:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788581219.638961:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.638968:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581219.638972:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.638979:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581219.638986:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.639005:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788581219.639007:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581219.639036:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639043:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581219.639061:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639068:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b2fa98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa9f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639081:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581219.639084:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639090:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581219.639093:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639100:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.639120:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581219.639176:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581219.639182:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581219.639199:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639205:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581219.639216:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639223:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b2fa8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa91 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639232:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581219.639235:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639241:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581219.639244:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639250:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.639265:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 24 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581219.639275:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581219.639280:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581219.639313:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639319:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788581219.639388:0:10305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184112128:0@lo:104: 00000100:00100000:3.0:1788581219.639419:0:10305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581219.639435:0:10305:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1788581219.639457:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4200/0x50f0cc74b7b2fb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e6d expref: 9 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.639468:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110208:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581219.639478:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21e66 expref: 8 pid: 6488 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.639486:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110336:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581219.639491:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.639496:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5200/0x50f0cc74b7b2fb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fb24 expref: 24 pid: 6488 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581219.639498:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6a400/0x50f0cc74b7b2fa7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.639504:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110464:0@lo:104: 00010000:00010000:2.0:1788581219.639507:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581219.639513:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110592:0@lo:104: 00010000:00010000:2.0:1788581219.639514:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581219.639516:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581219.639521:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031400/0x50f0cc74b7b2fae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fade expref: 23 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.639528:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110720:0@lo:104: 00010000:00010000:2.0:1788581219.639529:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581219.639537:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184110976:0@lo:104: 00000100:00100000:3.0:1788581219.639554:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111488:0@lo:104: 00000100:00100000:3.0:1788581219.639561:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111616:0@lo:104: 00000100:00100000:3.0:1788581219.639568:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111744:0@lo:104: 00010000:00010000:1.0:1788581219.639658:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272000/0x50f0cc74b7b2fb01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fafa expref: 22 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.639676:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581219.639708:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3618:x1875463184111232:12345-0@lo:103: Request processed in 5103us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581219.639715:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581219.639743:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184111360:0@lo:103: 00000100:00100000:1.0:1788581219.639766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581219.639789:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581219.639795:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184112384:0@lo:103: 00000100:00100000:1.0:1788581219.639814:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581219.639847:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184112256:0@lo:103: 00000100:00100000:1.0:1788581219.639850:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184111232:0@lo:103: 00000100:00100000:0.0:1788581219.639876:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581219.639894:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581219.639899:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184112000:0@lo:103: 00000100:00100000:0.0:1788581219.639938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581219.639964:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111360 00000100:00100000:0.0:1788581219.639969:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111360 00010000:00010000:0.0:1788581219.639989:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 21 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.640002:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112384 00000100:00100000:0.0:1788581219.640005:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112384 00010000:00010000:0.0:1788581219.640014:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 22 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.640022:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112256 00000100:00100000:0.0:1788581219.640024:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112256 00010000:00010000:0.0:1788581219.640033:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 23 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.640043:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112000 00000100:00100000:0.0:1788581219.640046:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112000 00010000:00010000:0.0:1788581219.640055:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 24 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.640066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581219.640072:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184111360:12345-0@lo:103: 00010000:00010000:0.0:1788581219.640080:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.640085:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640095:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640106:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40030a00/0x50f0cc74b7b2fabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fab4 expref: 24 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640122:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581219.640160:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3619:x1875463184111360:12345-0@lo:103: Request processed in 87us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.640167:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581219.640180:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581219.640187:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3619:x1875463184112384:12345-0@lo:103: 00010000:00010000:0.0:1788581219.640194:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.640199:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 22 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640207:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 22 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640218:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b2fa83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa7c expref: 22 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640227:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581219.640241:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184111360:0@lo:103: 00000100:00100000:0.0:1788581219.640249:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3619:x1875463184112384:12345-0@lo:103: Request processed in 64us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.640272:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581219.640285:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581219.640301:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3621:x1875463184112256:12345-0@lo:103: 00010000:00010000:0.0:1788581219.640309:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.640314:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 20 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640321:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 20 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.640537:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581219.640555:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581219.640565:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3621:x1875463184112000:12345-0@lo:103: 00000100:00100000:3.0:1788581219.640588:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184112384:0@lo:103: 00010000:00010000:0.0:1788581219.640593:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5800/0x50f0cc74b7b2fa91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa8a expref: 20 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640601:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581219.640627:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3621:x1875463184112256:12345-0@lo:103: Request processed in 328us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.640633:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581219.640671:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184112256:0@lo:103: 00000100:00100000:0.0:1788581219.640687:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184111872 00000100:00100000:0.0:1788581219.640690:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184111872 00000100:00100000:0.0:1788581219.640704:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112128 00000100:00100000:0.0:1788581219.640706:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112128 00000100:00100000:0.0:1788581219.640715:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581219.640720:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10305:x1875463184111872:12345-0@lo:104: 00010000:00010000:0.0:1788581219.640729:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640763:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581219.640768:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10305:x1875463184111872:12345-0@lo:104: Request processed in 48us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.640773:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581219.640784:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581219.640789:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184112128:12345-0@lo:104: 00010000:00010000:0.0:1788581219.640795:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640819:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581219.640829:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10305:x1875463184112128:12345-0@lo:104: Request processed in 40us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.640834:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788581219.640847:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581219.640851:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640857:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581219.640861:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640868:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581219.640875:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581219.640880:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581219.640905:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640921:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581219.640934:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640940:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5400/0x50f0cc74b7b2fa3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa44 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.640945:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.640950:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581219.640951:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 18 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640953:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.640961:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 18 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640968:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ae00 already unused, calling callback (ffffffffc1461c20) 00010000:00010000:1.0:1788581219.640972:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b2fa9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa98 expref: 18 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581219.640972:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.640980:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581219.640982:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:0.0:1788581219.640986:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581219.640991:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581219.641004:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641010:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788581219.641011:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3621:x1875463184112000:12345-0@lo:103: Request processed in 449us (1072us total) trans 0 rc 0/0 00010000:00010000:0.0:1788581219.641017:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641024:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6ae00/0x50f0cc74b7b2fa13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa1a expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581219.641025:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788581219.641036:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581219.641038:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581219.641040:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581219.641055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184112512:0@lo:103: 00000100:00100000:0.0:1788581219.641080:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581219.641111:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112512 00000100:00100000:0.0:1788581219.641115:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112512 00010000:00010000:0.0:1788581219.641128:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 17 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.641149:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581219.641155:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3619:x1875463184112512:12345-0@lo:103: 00010000:00010000:0.0:1788581219.641162:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.641166:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 17 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641174:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 17 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641184:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581219.641209:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3619:x1875463184112512:12345-0@lo:103: Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.641215:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581219.641232:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184112640:0@lo:103: 00000100:00100000:0.0:1788581219.641235:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184112512:0@lo:103: 00000100:00100000:1.0:1788581219.641273:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581219.641407:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112640 00000100:00100000:0.0:1788581219.641411:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112640 00000100:00100000:1.0:1788581219.641420:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184112000:0@lo:103: 00010000:00010000:0.0:1788581219.641424:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 17 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581219.641440:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581219.641446:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3620:x1875463184112640:12345-0@lo:103: 00010000:00010000:0.0:1788581219.641452:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581219.641456:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 17 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641465:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 17 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641488:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641496:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641508:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641514:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641521:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641527:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641533:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581219.641536:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641543:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641551:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581219.641559:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581219.641583:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:3620:x1875463184112640:12345-0@lo:103: Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581219.641596:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788581219.641776:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581219.641793:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fa44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa3d expref: 16 pid: 6487 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.641804:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184111872:0@lo:104: 00010000:00010000:3.0:1788581219.641814:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fa1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa13 expref: 15 pid: 6486 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581219.641822:0:10305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875463184112128:0@lo:104: 00000100:00100000:1.0:1788581219.641969:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184112640:0@lo:103: 00010000:00010000:3.0:1788581219.641999:0:10305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.642009:0:10305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.642012:0:10305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581219.642016:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.034117:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581220.161594:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581220.161617:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184112768:0@lo:13: 00000100:00100000:3.0:1788581220.161698:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.161729:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112768 00000100:00100000:0.0:1788581220.161739:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112768 00000100:00080000:3.0:1788581220.161766:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581220.161795:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581220.161804:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788581220.161805:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184112768:12345-0@lo:13: 00000100:00100000:3.0:1788581220.161816:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788581220.161836:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581220.161952:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184112768:12345-0@lo:13: Request processed in 149us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.161960:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581220.161983:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581220.161993:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184112896:0@lo:13: 00000100:00100000:0.0:1788581220.162026:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.162039:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184112896 00000100:00100000:2.0:1788581220.162045:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184112896 00000100:00100000:2.0:1788581220.162085:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581220.162093:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184112896:12345-0@lo:13: 00002000:00000024:2.0:1788581220.162105:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581220.162160:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184112896:12345-0@lo:13: Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.162166:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788581220.162250:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581220.163065:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43365880 x1875463184112896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581220.163091:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184112896:0@lo:13: 00010000:00080000:3.0:1788581220.163326:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363b80 x1875463184112768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581220.163342:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184112768:0@lo:13: 00000100:00100000:2.0:1788581220.456011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581220.456085:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170429952 00000100:00100000:3.0:1788581220.456095:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170429952 00000100:00100000:3.0:1788581220.456298:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:3.0:1788581220.456319:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+8:6163:x1875463170429952:12345-192.168.203.3@tcp:101: 00010000:00010000:3.0:1788581220.456343:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581220.456361:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21edd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.456403:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21edd expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.456414:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21edd expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.456425:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4600, rc 0) 00000100:00100000:3.0:1788581220.456482:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170429952:12345-192.168.203.3@tcp:101: Request processed in 166us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.456490:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:2.0:1788581220.468688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581220.469946:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430080 00000100:00100000:0.0:1788581220.469959:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430080 00000100:00100000:0.0:1788581220.470190:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1788581220.470202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430080:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1788581220.470449:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430080:12345-192.168.203.3@tcp:501: Request processed in 249us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.470458:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1788581220.476429:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581220.476605:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430208 00000100:00100000:3.0:1788581220.476615:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430208 00000100:00100000:3.0:1788581220.476674:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:3.0:1788581220.476698:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430208:12345-192.168.203.3@tcp:503: 00000100:00100000:3.0:1788581220.476836:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430208:12345-192.168.203.3@tcp:503: Request processed in 140us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.476844:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:1.0:1788581220.482636:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581220.484866:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430336 00000100:00100000:0.0:1788581220.484881:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430336 00000100:00100000:0.0:1788581220.485034:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:0.0:1788581220.485057:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6637:x1875463170430336:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1788581220.485430:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6637:x1875463170430336:12345-192.168.203.3@tcp:502: Request processed in 373us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.485438:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:0.0:1788581220.490231:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581220.490734:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430464 00000100:00100000:2.0:1788581220.490744:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430464 00000100:00100000:2.0:1788581220.490797:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1788581220.490807:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6637:x1875463170430464:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581220.490981:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6637:x1875463170430464:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 175us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.490990:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1788581220.503370:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581220.504937:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430592 00000100:00100000:0.0:1788581220.504951:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430592 00000100:00100000:0.0:1788581220.505019:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:0.0:1788581220.505031:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430592:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581220.505049:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581220.505068:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2fb8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21ee4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.505095:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2fb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ee4 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.505107:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2fb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ee4 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.505115:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40030400, rc 0) 00000100:00100000:0.0:1788581220.505185:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170430592:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.505192:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:1.0:1788581220.510150:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581220.510478:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430720 00000100:00100000:3.0:1788581220.510488:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430720 00000100:00100000:3.0:1788581220.510542:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:3.0:1788581220.510552:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170430720:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.510671:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170430720:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 120us (530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788581220.510687:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:0.0:1788581220.674964:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184113024:0@lo:41: 00000100:00100000:0.0:1788581220.675043:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581220.675185:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113024 00000100:00100000:1.0:1788581220.675194:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113024 00000100:00100000:1.0:1788581220.675249:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581220.675278:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184113024:12345-0@lo:41: 00000004:00000024:1.0:1788581220.675517:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788581220.675572:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184113024:12345-0@lo:41: Request processed in 295us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581220.675580:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788581220.676330:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184113024:0@lo:41: 10000000:01000000:0.0:1788581220.929342:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581220.929360:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6f944800 from 48 10000000:01000000:0.0:1788581220.929365:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581220.929406:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.929418:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.929429:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581220.929451:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113152:0@lo:101: 00000100:00100000:0.0:1788581220.929518:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.929581:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.929592:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113152 00000100:00100000:2.0:1788581220.929601:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113152 00000100:00100000:2.0:1788581220.929647:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788581220.929659:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+15:6490:x1875463184113152:12345-0@lo:101: 00010000:00010000:2.0:1788581220.929673:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.929691:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272e00/0x50f0cc74b7b2fb9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fb94 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.929714:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272e00/0x50f0cc74b7b2fb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb94 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.929723:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272e00/0x50f0cc74b7b2fb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb94 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.929733:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272e00, rc 0) 00000100:00100000:2.0:1788581220.929781:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113152:12345-0@lo:101: Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.929788:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788581220.929952:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113152:0@lo:101: 00010000:00010000:0.0:1788581220.929966:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.929975:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581220.930029:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113280:0@lo:501: 00000100:00100000:0.0:1788581220.930054:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.930080:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.930129:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113280 00000100:00100000:2.0:1788581220.930134:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113280 00000100:00100000:2.0:1788581220.930167:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788581220.930175:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113280:12345-0@lo:501: 00000100:00100000:2.0:1788581220.933287:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113280:12345-0@lo:501: Request processed in 3103us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.933300:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788581220.934513:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113280:0@lo:501: 00000100:00100000:0.0:1788581220.934576:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113408:0@lo:503: 00000100:00100000:0.0:1788581220.934648:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.934729:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.938120:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113408 00000100:00100000:2.0:1788581220.938135:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113408 00000100:00100000:3.0:1788581220.938758:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788581220.938769:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113408:12345-0@lo:503: 00000100:00100000:3.0:1788581220.938922:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113408:12345-0@lo:503: Request processed in 155us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.938930:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788581220.939009:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113408:0@lo:503: 00000100:00100000:2.0:1788581220.939210:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10326:1875463184113536:0@lo:502: 00000100:00100000:2.0:1788581220.939251:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.939814:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113536 00000100:00100000:0.0:1788581220.939820:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113536 00000100:00100000:0.0:1788581220.939848:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788581220.939855:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:10326:x1875463184113536:12345-0@lo:502: 00000100:00100000:0.0:1788581220.939957:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:10326:x1875463184113536:12345-0@lo:502: Request processed in 101us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.939965:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788581220.940069:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.940085:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10326:1875463184113536:0@lo:502: 00000100:00100000:3.0:1788581220.940126:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10326:1875463184113664:0@lo:502: 00000100:00100000:3.0:1788581220.940160:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.940227:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.940297:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113664 00000100:00100000:2.0:1788581220.940302:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113664 00000100:00100000:0.0:1788581220.941175:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788581220.941185:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:10326:x1875463184113664:12345-0@lo:502: 00000100:00100000:0.0:1788581220.941359:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:10326:x1875463184113664:12345-0@lo:502: Request processed in 175us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.941366:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788581220.941826:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10326:1875463184113664:0@lo:502: 00000040:00080000:2.0:1788581220.941861:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788581220.942038:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788581220.942064:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581220.942073:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.942085:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581220.942094:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788581220.942097:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788581220.942099:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581220.942125:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.942133:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.942152:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581220.942167:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113792:0@lo:101: 00000100:00100000:0.0:1788581220.942203:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.942530:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.942624:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113792 00000100:00100000:2.0:1788581220.942630:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113792 00000100:00100000:2.0:1788581220.942704:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788581220.942711:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+16:6490:x1875463184113792:12345-0@lo:101: 00010000:00010000:2.0:1788581220.942721:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.942732:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273400/0x50f0cc74b7b2fba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.942753:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273400/0x50f0cc74b7b2fba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fba2 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.942764:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273400/0x50f0cc74b7b2fba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fba2 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.942771:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273400, rc 0) 00000100:00100000:2.0:1788581220.942806:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184113792:12345-0@lo:101: Request processed in 96us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.942813:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788581220.942889:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113792:0@lo:101: 00010000:00010000:2.0:1788581220.942911:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.942920:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.942970:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113920:0@lo:501: 00000100:00100000:2.0:1788581220.942995:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.943067:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.943513:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184113920 00000100:00100000:0.0:1788581220.943519:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184113920 00000100:00100000:0.0:1788581220.943576:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788581220.943583:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184113920:12345-0@lo:501: 00000100:00100000:0.0:1788581220.943689:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184113920:12345-0@lo:501: Request processed in 107us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.943696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788581220.943748:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184113920:0@lo:501: 00000100:00100000:2.0:1788581220.943777:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114048:0@lo:503: 00000100:00100000:3.0:1788581220.948049:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.948092:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.948168:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114048 00000100:00100000:0.0:1788581220.948177:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114048 00000100:00100000:0.0:1788581220.948231:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788581220.948241:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184114048:12345-0@lo:503: 00000100:00100000:0.0:1788581220.948385:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184114048:12345-0@lo:503: Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.948393:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788581220.948538:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114048:0@lo:503: 00000100:00100000:3.0:1788581220.949068:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10329:1875463184114176:0@lo:502: 00000100:00100000:3.0:1788581220.949115:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.949181:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.949217:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114176 00000100:00100000:0.0:1788581220.949222:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114176 00000100:00100000:0.0:1788581220.949420:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788581220.949430:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:10329:x1875463184114176:12345-0@lo:502: 00000100:00100000:0.0:1788581220.949523:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:10329:x1875463184114176:12345-0@lo:502: Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.949538:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788581220.949606:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10329:1875463184114176:0@lo:502: 00000020:01000000:3.0:1788581220.949631:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581220.949641:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581220.949643:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581220.949648:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788581220.949668:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10329:1875463184114304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.949699:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.949809:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114304 00000100:00100000:2.0:1788581220.949814:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114304 00000100:00100000:2.0:1788581220.949835:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788581220.949841:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:10329:x1875463184114304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.949920:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:10329:x1875463184114304:12345-0@lo:502:llog_process_th.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.949927:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788581220.950016:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.950029:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10329:1875463184114304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581220.950048:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581220.950052:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581220.950054:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581220.950057:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788581220.950218:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788581220.950238:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788581220.950246:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.950439:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581220.950449:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581220.950452:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6f8e1800 from 48 10000000:01000000:0.0:1788581220.950454:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581220.950478:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.950486:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.950495:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581220.950510:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.950542:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.950598:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4325f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.950635:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114432 00000100:00100000:2.0:1788581220.950640:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114432 00000100:00100000:2.0:1788581220.950703:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788581220.950710:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+17:6490:x1875463184114432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.950719:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.950730:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273000/0x50f0cc74b7b2fbb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.950750:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273000/0x50f0cc74b7b2fbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbb0 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.950759:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273000/0x50f0cc74b7b2fbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbb0 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.950767:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273000, rc 0) 00000100:00100000:2.0:1788581220.950804:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184114432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.950818:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788581220.950869:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581220.950882:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.950890:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581220.950944:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.950965:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.951051:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.951078:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114560 00000100:00100000:0.0:1788581220.951082:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114560 00000100:00100000:0.0:1788581220.951099:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788581220.951104:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184114560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.951194:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184114560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.951216:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788581220.951516:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.951541:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.951584:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.951613:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.951660:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114688 00000100:00100000:0.0:1788581220.951665:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114688 00000100:00100000:0.0:1788581220.951695:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788581220.951701:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184114688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.951770:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184114688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.951777:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788581220.951844:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184114688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.952786:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10331:1875463184114816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581220.952830:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.952857:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4325fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.952912:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114816 00000100:00100000:3.0:1788581220.952918:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114816 00000100:00100000:3.0:1788581220.952953:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788581220.952961:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:10331:x1875463184114816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.953041:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:10331:x1875463184114816:12345-0@lo:502:llog_process_th.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.953047:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788581220.953110:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10331:1875463184114816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581220.953141:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10331:1875463184114944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581220.953169:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.953191:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4325fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.953229:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184114944 00000100:00100000:3.0:1788581220.953234:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184114944 00000100:00100000:3.0:1788581220.953275:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788581220.953282:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:10331:x1875463184114944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.953340:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:10331:x1875463184114944:12345-0@lo:502:llog_process_th.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.953346:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788581220.953525:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10331:1875463184114944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788581220.953543:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788581220.956401:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788581220.956435:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581220.956446:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956458:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581220.956468:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788581220.956471:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788581220.956482:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788581220.956516:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956524:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956534:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581220.956560:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.956621:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.956652:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.956676:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115072 00000100:00100000:3.0:1788581220.956683:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115072 00000100:00100000:3.0:1788581220.956721:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788581220.956729:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+18:6490:x1875463184115072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581220.956742:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581220.956753:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fbc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbbe expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956773:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbbe expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956783:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbbe expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956792:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4c00, rc 0) 00000100:00100000:3.0:1788581220.956826:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.956840:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788581220.956890:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581220.956915:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.956924:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581220.956972:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.956997:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.957011:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.957023:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115200 00000100:00100000:3.0:1788581220.957027:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115200 00000100:00100000:3.0:1788581220.957047:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788581220.957054:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.957153:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.957159:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788581220.957188:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.957214:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.957249:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.957282:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.957295:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115328 00000100:00100000:3.0:1788581220.957298:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115328 00000100:00100000:3.0:1788581220.957318:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788581220.957330:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.957403:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.957409:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788581220.957445:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.957635:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10332:1875463184115456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.957665:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.957684:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115456 00000100:00100000:3.0:1788581220.957687:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115456 00000100:00100000:3.0:1788581220.957707:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788581220.957713:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:10332:x1875463184115456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.957777:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:10332:x1875463184115456:12345-0@lo:502:llog_process_th.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.957784:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788581220.957806:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.957816:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10332:1875463184115456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581220.957834:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581220.957841:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581220.957843:0:10332:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581220.957847:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788581220.957863:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10332:1875463184115584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.957889:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.957917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115584 00000100:00100000:3.0:1788581220.957921:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115584 00000100:00100000:3.0:1788581220.957940:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788581220.957946:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:10332:x1875463184115584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.957999:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:10332:x1875463184115584:12345-0@lo:502:llog_process_th.0 Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.958005:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788581220.958027:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.958036:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10332:1875463184115584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581220.958050:0:10332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581220.958054:0:10332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581220.958055:0:10332:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581220.958059:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788581220.958096:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788581220.958108:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581220.958116:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958123:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581220.958131:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581220.958133:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4f1e6000 from 48 10000000:01000000:3.0:1788581220.958135:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581220.958150:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958156:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958163:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581220.958182:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958203:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.958214:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.958224:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115712 00000100:00100000:3.0:1788581220.958227:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115712 00000100:00100000:3.0:1788581220.958244:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788581220.958250:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:6490:x1875463184115712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581220.958276:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581220.958286:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2fbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbcc expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958301:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2fbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbcc expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958310:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2fbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbcc expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958318:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5600, rc 0) 00000100:00100000:3.0:1788581220.958346:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184115712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.958351:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788581220.958379:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581220.958389:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581220.958397:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581220.958443:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958468:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.958481:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.958492:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115840 00000100:00100000:3.0:1788581220.958495:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115840 00000100:00100000:3.0:1788581220.958514:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788581220.958520:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184115840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958592:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184115840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.958599:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788581220.958626:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958647:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958677:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.958690:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.958700:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184115968 00000100:00100000:3.0:1788581220.958703:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184115968 00000100:00100000:3.0:1788581220.958722:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788581220.958727:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184115968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.958785:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184115968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.958791:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788581220.958824:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184115968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581220.959007:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10333:1875463184116096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.959039:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.959054:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116096 00000100:00100000:3.0:1788581220.959057:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116096 00000100:00100000:3.0:1788581220.959073:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788581220.959079:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:10333:x1875463184116096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.959138:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:10333:x1875463184116096:12345-0@lo:502:llog_process_th.0 Request processed in 58us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581220.959144:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788581220.959859:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581220.959879:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10333:1875463184116096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.960441:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10333:1875463184116224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581220.960489:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581220.960525:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.960567:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116224 00000100:00100000:2.0:1788581220.960573:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116224 00000100:00100000:2.0:1788581220.960611:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788581220.960618:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:10333:x1875463184116224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.960707:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:10333:x1875463184116224:12345-0@lo:502:llog_process_th.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.960714:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788581220.960778:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10333:1875463184116224:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788581220.960797:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788581220.960933:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788581220.960952:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581220.960961:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.960972:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581220.960981:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788581220.960983:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788581220.960986:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788581220.961008:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.961016:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.961024:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.961036:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.961074:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.961098:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.961140:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116352 00000100:00100000:0.0:1788581220.961144:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116352 00000100:00100000:0.0:1788581220.961173:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788581220.961180:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184116352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581220.961187:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581220.961204:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2fbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.961223:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2fbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbda expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.961233:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2fbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbda expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.961241:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e40031a00, rc 0) 00000100:00100000:0.0:1788581220.961295:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.961301:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788581220.961381:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.961392:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.961400:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.961444:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.961466:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.961493:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.961527:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116480 00000100:00100000:0.0:1788581220.961531:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116480 00000100:00100000:0.0:1788581220.961555:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788581220.961560:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.961639:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.961645:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788581220.961891:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.961925:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.961957:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.961976:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.962009:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116608 00000100:00100000:0.0:1788581220.962012:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116608 00000100:00100000:0.0:1788581220.962036:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788581220.962041:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.962103:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.962110:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788581220.962294:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.962580:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10334:1875463184116736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.962612:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.962640:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.962678:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116736 00000100:00100000:0.0:1788581220.962687:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116736 00000100:00100000:0.0:1788581220.962717:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788581220.962723:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10334:x1875463184116736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581220.962792:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10334:x1875463184116736:12345-0@lo:502:llog_process_th.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.962799:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788581220.962865:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10334:1875463184116736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581220.962885:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581220.962892:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581220.962895:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581220.962910:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788581220.962934:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10334:1875463184116864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.962964:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.962987:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.963026:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116864 00000100:00100000:0.0:1788581220.963031:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116864 00000100:00100000:0.0:1788581220.963061:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788581220.963067:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10334:x1875463184116864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581220.963125:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10334:x1875463184116864:12345-0@lo:502:llog_process_th.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.963132:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788581220.963197:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10334:1875463184116864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581220.963211:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581220.963214:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581220.963216:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581220.963218:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788581220.963358:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788581220.963374:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788581220.963382:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.963391:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581220.963400:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581220.963403:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3a800 from 48 10000000:01000000:0.0:1788581220.963406:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581220.963426:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.963434:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.963447:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581220.963459:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.963483:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.963510:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4325f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.963550:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184116992 00000100:00100000:2.0:1788581220.963554:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184116992 00000100:00100000:2.0:1788581220.963582:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788581220.963588:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184116992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.963596:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.963606:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273c00/0x50f0cc74b7b2fbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbe8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.963625:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273c00/0x50f0cc74b7b2fbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbe8 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.963633:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273c00/0x50f0cc74b7b2fbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbe8 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.963642:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273c00, rc 0) 00000100:00100000:2.0:1788581220.963670:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184116992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.963675:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788581220.963701:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184116992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.963712:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.963725:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.963764:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.963786:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.963798:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.963808:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117120 00000100:00100000:2.0:1788581220.963811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117120 00000100:00100000:2.0:1788581220.963842:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788581220.963847:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184117120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.963939:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184117120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.963945:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788581220.963973:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.963994:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.964021:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.964032:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.964041:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117248 00000100:00100000:2.0:1788581220.964043:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117248 00000100:00100000:2.0:1788581220.964056:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788581220.964061:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184117248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.964113:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184117248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.964119:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788581220.964150:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.964279:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10336:1875463184117376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.964309:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.964325:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117376 00000100:00100000:2.0:1788581220.964328:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117376 00000100:00100000:2.0:1788581220.964342:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788581220.964347:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10336:x1875463184117376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.964410:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10336:x1875463184117376:12345-0@lo:502:llog_process_th.0 Request processed in 62us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.964417:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788581220.964446:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.964457:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10336:1875463184117376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.964487:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10336:1875463184117504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.964517:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.964533:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117504 00000100:00100000:2.0:1788581220.964537:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117504 00000100:00100000:2.0:1788581220.964552:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788581220.964557:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10336:x1875463184117504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.964610:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10336:x1875463184117504:12345-0@lo:502:llog_process_th.0 Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.964616:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788581220.964639:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.964650:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10336:1875463184117504:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788581220.964666:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788581220.966515:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788581220.966545:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581220.966555:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.966566:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581220.966576:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788581220.966579:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788581220.966595:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788581220.966625:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.966633:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.966641:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581220.966662:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581220.966715:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581220.966743:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.968713:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117632 00000100:00100000:2.0:1788581220.968724:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117632 00000100:00100000:2.0:1788581220.968777:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788581220.968787:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184117632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.968800:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.968815:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273a00/0x50f0cc74b7b2fbfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fbf6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.968839:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273a00/0x50f0cc74b7b2fbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbf6 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.968849:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273a00/0x50f0cc74b7b2fbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbf6 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.968858:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273a00, rc 0) 00000100:00100000:2.0:1788581220.968926:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184117632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.968933:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788581220.968980:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.968994:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.969004:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.969064:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.969090:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.969112:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1788581220.969163:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117760 00000100:00100000:0.0:1788581220.969167:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117760 00000100:00100000:0.0:1788581220.969194:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788581220.969200:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184117760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581220.969334:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184117760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.969341:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788581220.969552:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.969580:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.969620:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.969646:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.969658:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184117888 00000100:00100000:2.0:1788581220.969662:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184117888 00000100:00100000:2.0:1788581220.969690:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788581220.969697:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184117888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.969771:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184117888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.969777:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788581220.969812:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184117888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.969990:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10337:1875463184118016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.970025:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.970043:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118016 00000100:00100000:2.0:1788581220.970047:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118016 00000100:00100000:2.0:1788581220.970064:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788581220.970070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10337:x1875463184118016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.970136:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10337:x1875463184118016:12345-0@lo:502:llog_process_th.0 Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.970142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788581220.970168:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.970180:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10337:1875463184118016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581220.970201:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581220.970214:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581220.970217:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581220.970222:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788581220.970239:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10337:1875463184118144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.970367:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.970385:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118144 00000100:00100000:2.0:1788581220.970389:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118144 00000100:00100000:2.0:1788581220.970406:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788581220.970411:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10337:x1875463184118144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581220.970467:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10337:x1875463184118144:12345-0@lo:502:llog_process_th.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.970473:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788581220.970504:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.970514:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10337:1875463184118144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581220.970532:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581220.970535:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581220.970537:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581220.970541:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788581220.970577:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788581220.970590:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581220.970598:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970607:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581220.970616:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581220.970619:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7557cd28 from 1 10000000:01000000:2.0:1788581220.970621:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581220.970643:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970651:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970660:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.970671:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184118272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.970692:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.970703:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.970712:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118272 00000100:00100000:2.0:1788581220.970715:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118272 00000100:00100000:2.0:1788581220.970729:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788581220.970734:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184118272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.970741:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581220.970750:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273600/0x50f0cc74b7b2fc0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc04 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970765:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273600/0x50f0cc74b7b2fc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc04 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970774:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273600/0x50f0cc74b7b2fc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc04 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970782:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273600, rc 0) 00000100:00100000:2.0:1788581220.970803:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184118272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581220.970809:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788581220.970837:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184118272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581220.970847:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.970855:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581220.970886:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184118400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.970922:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.970934:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581220.970942:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118400 00000100:00100000:2.0:1788581220.970945:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118400 00000100:00100000:2.0:1788581220.970958:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788581220.970962:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184118400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581220.971006:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184118400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (83us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581220.971013:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788581220.971034:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184118400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788581220.971049:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581220.971053:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581220.971062:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.059289:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788581221.440806:0:10368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6eef1f30 20000000:00000080:3.0:1788581221.440824:0:10368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e6fb0d000 uarg=0000000000000000 20000000:01000000:3.0:1788581221.440874:0:10368:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788581221.440880:0:10368:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788581221.440884:0:10368:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788581221.442234:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788581221.442487:0:10368:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788581221.448414:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788581221.448480:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788581221.448497:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788581221.448523:0:10368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581221.448549:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448567:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448575:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448583:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448590:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448600:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448608:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448655:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.448671:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 9 pid: 6487 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.448685:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118528:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581221.449754:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.449766:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 23 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.449777:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118656:0@lo:104: 00000100:00100000:2.0:1788581221.449822:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581221.449858:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.449866:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.449874:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118784:0@lo:104: 00000100:00100000:2.0:1788581221.449904:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581221.449945:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.449953:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 23 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.449962:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118912:0@lo:104: 00010000:00010000:2.0:1788581221.449994:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.450010:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 23 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.450018:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184119040:0@lo:104: 00000100:00100000:2.0:1788581221.450061:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581221.450291:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581221.450319:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581221.450333:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581221.450341:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118656 00000100:00100000:0.0:1788581221.450352:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118656 00000100:00100000:0.0:1788581221.450390:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118784 00000100:00100000:0.0:1788581221.450393:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118784 00000100:00100000:0.0:1788581221.450407:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184118912 00000100:00100000:0.0:1788581221.450410:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184118912 00000100:00100000:0.0:1788581221.450419:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119040 00000100:00100000:0.0:1788581221.450421:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119040 00000100:00100000:0.0:1788581221.450434:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581221.450444:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:10368:x1875463184118656:12345-0@lo:104: 00010000:00010000:0.0:1788581221.450593:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.450660:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581221.450666:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+6:10368:x1875463184118656:12345-0@lo:104: Request processed in 225us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.450673:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581221.450687:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581221.450694:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:10368:x1875463184118784:12345-0@lo:104: 00010000:00010000:0.0:1788581221.450701:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.450733:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581221.450738:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:10368:x1875463184118784:12345-0@lo:104: Request processed in 45us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.450743:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581221.450770:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581221.450775:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10368:x1875463184118912:12345-0@lo:104: 00010000:00010000:0.0:1788581221.450781:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.450809:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581221.450813:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:10368:x1875463184118912:12345-0@lo:104: Request processed in 39us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.450819:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581221.450831:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581221.450837:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10368:x1875463184119040:12345-0@lo:104: 00010000:00010000:1.0:1788581221.450838:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581221.450845:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.450848:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.450867:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581221.450873:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.450883:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.450887:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:1.0:1788581221.450906:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581221.450910:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:10368:x1875463184119040:12345-0@lo:104: Request processed in 58us (561us total) trans 0 rc 0/0 10000000:01000000:1.0:1788581221.450916:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788581221.450922:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788581221.450951:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.450969:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581221.450991:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.450998:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b2fa2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fa36 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451010:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788581221.451013:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451019:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581221.451021:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451029:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581221.451036:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581221.451041:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581221.451054:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451058:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581221.451062:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451066:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5a00/0x50f0cc74b7b2f909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f910 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451077:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581221.451079:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451082:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581221.451084:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451088:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581221.451091:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581221.451094:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581221.451459:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581221.451465:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.451473:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581221.451476:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.451483:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581221.451489:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581221.451494:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581221.451509:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.451742:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581221.451765:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.451771:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0ea00/0x50f0cc74b7b2f8ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8b5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.451791:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581221.451793:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581221.451794:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581221.451800:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581221.451812:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184119424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581221.451849:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581221.451856:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451865:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581221.451876:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.451883:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2f8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2f8c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581221.451884:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184119552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581221.451917:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581221.452017:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581221.452020:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581221.452022:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581221.452026:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581221.452036:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581221.452071:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118656:0@lo:104: 00000100:00100000:1.0:1788581221.452078:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581221.452086:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118784:0@lo:104: 00000100:00100000:2.0:1788581221.452097:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118912:0@lo:104: 00000100:00100000:1.0:1788581221.452122:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581221.452130:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581221.452159:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184119040:0@lo:104: 00000100:00100000:0.0:1788581221.452201:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119424 00000100:00100000:0.0:1788581221.452207:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119424 00010000:00010000:0.0:1788581221.452230:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 24 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581221.452459:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581221.452853:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581221.452870:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119552 00000100:00100000:2.0:1788581221.452885:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119168 00000100:00100000:2.0:1788581221.452889:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119168 00010000:00010000:2.0:1788581221.452916:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 25 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.452932:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119296 00000100:00100000:2.0:1788581221.452942:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119296 00010000:00010000:2.0:1788581221.452953:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 26 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.452969:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581221.452981:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+26:3619:x1875463184119424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581221.452993:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581221.452998:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 26 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.453007:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 26 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581221.453014:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788581221.453024:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b2f8b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8ae expref: 26 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581221.453027:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+26:3620:x1875463184119168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581221.453040:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581221.453046:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581221.453047:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 25 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.453059:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 25 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.453071:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fa36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fa2f expref: 25 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581221.453081:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581221.453097:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184119424:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581221.453106:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581221.453122:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581221.453128:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3620:x1875463184119296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581221.453135:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581221.453140:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.453148:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.453158:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2f910 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f909 expref: 23 pid: 6487 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.453166:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581221.453194:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3620:x1875463184119296:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581221.453200:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581221.453231:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875463184118528:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581221.453303:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581221.453414:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119552 00010000:00010000:0.0:1788581221.453431:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 22 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581221.453455:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581221.453462:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3619:x1875463184119552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581221.453469:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581221.453473:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 22 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.453482:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 22 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.453492:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b2f8c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2f8bc expref: 22 pid: 6486 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581221.453509:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581221.453546:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3619:x1875463184119552:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.453552:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581221.453578:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184119552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581221.453587:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184119424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581221.454203:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430848 00000100:00100000:0.0:1788581221.454209:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430848 00010000:00010000:0.0:1788581221.454230:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581221.454695:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1788581221.454707:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170430848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581221.454719:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581221.454725:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454751:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454765:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272400/0x50f0cc74b7b2fb4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ea5 expref: 10 pid: 6487 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454778:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454785:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454799:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454805:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454811:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454817:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454822:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581221.454826:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.454832:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581221.454995:0:10368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581221.455003:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.455609:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.455620:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fc12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581221.455703:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581221.455798:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+9:2395:x1875463170430848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1091us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581221.455808:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1788581221.456499:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184119168:12345-0@lo:103:ldlm_bl.0 Request processed in 3471us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581221.456511:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581221.456591:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581221.456603:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581221.936125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581221.936217:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170430976 00000100:00100000:3.0:1788581221.936236:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170430976 00000100:00100000:3.0:1788581221.936317:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:3.0:1788581221.936337:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+9:6163:x1875463170430976:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581221.936353:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581221.936372:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21eeb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581221.936398:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581221.936408:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581221.936417:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5c00, rc 0) 00000100:00100000:3.0:1788581221.936474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170430976:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581221.936481:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:0.0:1788581221.938580:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581221.938761:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431104 00000100:00100000:1.0:1788581221.938770:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431104 00000100:00100000:1.0:1788581221.938821:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:1.0:1788581221.938831:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170431104:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581221.939466:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170431104:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 634us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581221.939475:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:1.0:1788581221.945181:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581221.945340:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431232 00000100:00100000:0.0:1788581221.945349:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431232 00000100:00100000:0.0:1788581221.945396:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:0.0:1788581221.945404:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170431232:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581221.945537:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6163:x1875463170431232:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.945544:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:3.0:1788581221.955645:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581221.955856:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431360 00000100:00100000:1.0:1788581221.955866:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431360 00000100:00100000:1.0:1788581221.955941:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:1.0:1788581221.955953:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6695:x1875463170431360:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581221.956112:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6695:x1875463170431360:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 161us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581221.956121:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:1.0:1788581221.967604:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581221.967676:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431488 00000100:00100000:3.0:1788581221.967686:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431488 00000100:00100000:3.0:1788581221.967737:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:3.0:1788581221.967747:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6695:x1875463170431488:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581221.970970:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:6695:x1875463170431488:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 3213us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581221.970984:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00010000:00010000:2.0:1788581222.081529:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581222.210470:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119680:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210538:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.210567:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119680 00000100:00100000:3.0:1788581222.210576:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119680 00000100:00100000:2.0:1788581222.210592:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184120192:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210619:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.210626:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788581222.210641:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184120704:0@lo:400:kworker.0 00000100:00100000:3.0:1788581222.210647:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184119680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.210682:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184121216:0@lo:400:kworker.0 00000100:00100000:3.0:1788581222.210708:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184119680:12345-0@lo:400:kworker.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.210715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.210724:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788581222.210769:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184119680:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210782:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581222.210789:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184119808:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.210839:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184120320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210869:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.210904:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184120832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210930:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.210953:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184119936:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.210985:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211007:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184120448:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211029:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211049:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184120960:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211069:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211081:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788581222.211086:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184120064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211116:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184120576:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184121088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211190:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.211220:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120192 00000100:00100000:2.0:1788581222.211225:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120192 00000100:00100000:2.0:1788581222.211275:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119936 00000100:00100000:2.0:1788581222.211280:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119936 00000100:00100000:2.0:1788581222.211298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581222.211305:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184120192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211350:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184120192:12345-0@lo:400:kworker.0 Request processed in 45us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211357:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581222.211372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581222.211379:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184119936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211419:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184119936:12345-0@lo:400:kworker.0 Request processed in 41us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211426:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581222.211446:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120704 00000100:00100000:2.0:1788581222.211449:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120704 00000100:00100000:2.0:1788581222.211480:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121216 00000100:00100000:2.0:1788581222.211484:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121216 00000100:00100000:2.0:1788581222.211501:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120576 00000100:00100000:2.0:1788581222.211504:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120576 00000100:00100000:2.0:1788581222.211520:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121088 00000100:00100000:2.0:1788581222.211523:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121088 00000100:00100000:2.0:1788581222.211543:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581222.211551:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184120704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211585:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184120704:12345-0@lo:400:kworker.0 Request processed in 36us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211591:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581222.211609:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581222.211616:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184121216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211644:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184121216:12345-0@lo:400:kworker.0 Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211650:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581222.211664:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581222.211671:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184120576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211700:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184120576:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211706:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581222.211723:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581222.211737:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184121088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211770:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184121088:12345-0@lo:400:kworker.0 Request processed in 35us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211776:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581222.211804:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184119808 00000100:00100000:2.0:1788581222.211807:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184119808 00000100:00100000:2.0:1788581222.211827:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120320 00000100:00100000:2.0:1788581222.211830:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120320 00000100:00100000:2.0:1788581222.211845:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120832 00000100:00100000:2.0:1788581222.211848:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120832 00000100:00100000:2.0:1788581222.211863:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120448 00000100:00100000:2.0:1788581222.211866:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120448 00000100:00100000:2.0:1788581222.211883:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120960 00000100:00100000:2.0:1788581222.211887:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120960 00000100:00100000:2.0:1788581222.211915:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184120064 00000100:00100000:2.0:1788581222.211918:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184120064 00000100:00100000:2.0:1788581222.211932:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581222.211937:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184119808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.211965:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184119808:12345-0@lo:400:kworker.0 Request processed in 27us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.211970:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581222.211982:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581222.211988:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184120320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.212012:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184120320:12345-0@lo:400:kworker.0 Request processed in 25us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.212017:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581222.212028:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581222.212033:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184120832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.212066:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184120832:12345-0@lo:400:kworker.0 Request processed in 33us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.212072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581222.212082:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581222.212087:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184120448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.212106:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184120448:12345-0@lo:400:kworker.0 Request processed in 19us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.212111:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581222.212119:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581222.212123:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184120960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.212159:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184120960:12345-0@lo:400:kworker.0 Request processed in 36us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.212166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581222.213339:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581222.213352:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184120064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.213405:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184120064:12345-0@lo:400:kworker.0 Request processed in 57us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.213412:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788581222.213456:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581222.213460:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581222.213463:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581222.213465:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581222.213494:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184120064:0@lo:400:kworker.0 00010000:00080000:2.0:1788581222.213512:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43365500 x1875463184120576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581222.213512:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184121344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581222.213545:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184120576:0@lo:400:kworker.0 00010000:00080000:2.0:1788581222.213663:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43366680 x1875463184121088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581222.213672:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184121088:0@lo:400:kworker.0 00000100:00100000:0.0:1788581222.213713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.213753:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121344 00000100:00100000:0.0:1788581222.213758:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121344 00000100:00100000:0.0:1788581222.213789:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581222.213798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184119936:0@lo:400:kworker.0 00000100:00100000:0.0:1788581222.213799:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184121344:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788581222.213813:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43367480 x1875463184120448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788581222.213828:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581222.213864:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184121344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.213871:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788581222.213907:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b132300 x1875463184121344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581222.213922:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184121344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581222.214762:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581222.214775:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184121472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581222.214810:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.214907:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121472 00000100:00100000:0.0:1788581222.214913:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121472 00000100:00100000:2.0:1788581222.214917:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184120448:0@lo:400:kworker.0 00010000:00080000:2.0:1788581222.214938:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43366300 x1875463184120960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581222.214949:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184120960:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.215029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184119808:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.215046:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184120320:0@lo:400:kworker.0 00000100:00100000:0.0:1788581222.215050:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581222.215060:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184121472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581222.215073:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581222.215112:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184121472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.215118:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788581222.215180:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b132300 x1875463184121472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581222.215193:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184121472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581222.215297:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184120832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581222.215309:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184120192:0@lo:400:kworker.0 00010000:00080000:2.0:1788581222.215320:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43366d80 x1875463184120704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581222.215329:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184120704:0@lo:400:kworker.0 00010000:00080000:2.0:1788581222.215340:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43366a00 x1875463184121216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581222.215357:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184121216:0@lo:400:kworker.0 00000100:00100000:1.0:1788581222.644820:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581222.644917:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581222.644950:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581222.644989:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581222.645033:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431616 00000100:00100000:3.0:1788581222.645043:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431616 00000100:00100000:3.0:1788581222.645094:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:3.0:1788581222.645102:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170431616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581222.645166:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170431616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 65us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.645174:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:3.0:1788581222.645340:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432000 00000100:00100000:3.0:1788581222.645344:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432000 00000100:00100000:3.0:1788581222.645381:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1788581222.645388:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432000:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581222.645421:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432000:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.645502:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00080000:3.0:1788581222.645573:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581222.648671:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581222.650405:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431744 00000100:00100000:2.0:1788581222.650418:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431744 00000100:00100000:2.0:1788581222.650494:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170431872 00000100:00100000:2.0:1788581222.650777:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170431872 00000100:00100000:2.0:1788581222.650816:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581222.650826:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170431744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581222.650914:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170431744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 90us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.650922:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581222.651013:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581222.651021:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170431872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581222.651049:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170431872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (6060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.651055:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581222.651079:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432128 00000100:00100000:2.0:1788581222.651083:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432128 00000100:00100000:2.0:1788581222.651107:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581222.651113:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170432128:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581222.651137:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170432128:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581222.651143:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00080000:1.0:1788581222.652309:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581222.652316:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581222.652318:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788581222.916656:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581222.916664:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f944800 from 4 10000000:01000000:0.0:1788581222.916669:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581222.916717:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581222.916727:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581222.916749:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581222.916774:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.916839:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.918313:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.918961:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121600 00000100:00100000:1.0:1788581222.919035:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121600 00000100:00100000:1.0:1788581222.919134:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788581222.919146:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184121600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.919162:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581222.919178:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc20 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.919214:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.919226:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.919235:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581222.919323:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184121600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.919331:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788581222.919506:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581222.919526:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581222.919543:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581222.919615:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581222.919649:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581222.919880:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581222.919951:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121728 00000100:00100000:3.0:1788581222.919957:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121728 00000100:00100000:0.0:1788581222.920013:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788581222.920022:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184121728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.920139:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184121728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.920146:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788581222.920178:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.920206:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.920244:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.920276:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581222.920288:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121856 00000100:00100000:0.0:1788581222.920291:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121856 00000100:00100000:0.0:1788581222.920310:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788581222.920315:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184121856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.920390:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184121856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.920514:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788581222.920555:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184121856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.920741:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10437:1875463184121984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581222.920776:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.920794:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184121984 00000100:00100000:0.0:1788581222.920797:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184121984 00000100:00100000:0.0:1788581222.920815:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788581222.920821:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10437:x1875463184121984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581222.920899:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10437:x1875463184121984:12345-0@lo:502:llog_process_th.0 Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.920906:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788581222.920933:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581222.920944:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10437:1875463184121984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581222.921027:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581222.921037:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581222.921040:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581222.921046:0:10437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6f944800 00000020:00000080:0.0:1788581222.921049:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581222.922902:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10437:1875463184122112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.924997:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.925048:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581222.925152:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122112 00000100:00100000:0.0:1788581222.925161:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122112 00000100:00100000:0.0:1788581222.925281:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788581222.925292:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10437:x1875463184122112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581222.925428:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:10437:x1875463184122112:12345-0@lo:502:llog_process_th.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581222.925435:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788581222.926137:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10437:1875463184122112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581222.926170:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581222.926178:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581222.926181:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788581222.926186:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788581222.926379:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788581222.926488:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581222.926498:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.926515:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581222.926526:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581222.926528:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f8e1800 from 4 10000000:01000000:3.0:1788581222.926531:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581222.926560:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.926568:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.926578:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581222.926597:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581222.926640:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.926678:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.926730:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122240 00000100:00100000:1.0:1788581222.926735:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122240 00000100:00100000:1.0:1788581222.926847:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788581222.926856:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184122240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.926868:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581222.926879:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.926912:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.926928:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.926937:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:3.0:1788581222.927063:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581222.927076:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.927084:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581222.927134:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581222.927280:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.927303:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581222.927317:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122368 00000100:00100000:3.0:1788581222.927320:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122368 00000100:00100000:3.0:1788581222.927340:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788581222.927346:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184122368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581222.927551:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184122368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.927558:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788581222.927626:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.927655:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581222.927694:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.927720:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581222.927866:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122496 00000100:00100000:3.0:1788581222.927871:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122496 00000100:00100000:3.0:1788581222.927903:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788581222.927910:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184122496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581222.931382:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184122496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3465us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.931410:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788581222.931489:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.932920:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184122240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6059us (6273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.932931:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788581222.934632:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10440:1875463184122624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581222.934708:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.935074:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.936597:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122624 00000100:00100000:1.0:1788581222.936609:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122624 00000100:00100000:1.0:1788581222.936669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788581222.936679:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10440:x1875463184122624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.936834:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10440:x1875463184122624:12345-0@lo:502:llog_process_th.0 Request processed in 156us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.936842:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788581222.937127:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10440:1875463184122624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581222.937163:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581222.937173:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581222.937175:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788581222.937183:0:10440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6f8e1800 00000020:00000080:3.0:1788581222.937185:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788581222.937556:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10440:1875463184122752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581222.937612:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.937640:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122752 00000100:00100000:3.0:1788581222.937645:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122752 00000100:00100000:3.0:1788581222.937673:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788581222.937680:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10440:x1875463184122752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581222.937772:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:10440:x1875463184122752:12345-0@lo:502:llog_process_th.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.937779:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788581222.937816:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581222.937828:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10440:1875463184122752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581222.937847:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581222.937852:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581222.937854:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788581222.937858:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788581222.953700:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788581222.953736:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581222.953748:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.953831:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581222.953843:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581222.953845:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4f1e6000 from 4 10000000:01000000:1.0:1788581222.953847:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581222.953882:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.953912:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.953924:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581222.953950:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954013:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.954062:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.954084:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184122880 00000100:00100000:1.0:1788581222.954091:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184122880 00000100:00100000:1.0:1788581222.954135:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788581222.954145:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184122880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.954158:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581222.954170:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc3c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.954191:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.954201:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.954209:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ae00, rc 0) 00000100:00100000:1.0:1788581222.954248:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184122880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.954277:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788581222.954324:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184122880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.954339:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.954347:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581222.954441:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954468:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.954487:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.954499:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123008 00000100:00100000:1.0:1788581222.954502:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123008 00000100:00100000:1.0:1788581222.954523:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788581222.954529:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184123008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954623:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184123008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.954629:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788581222.954654:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954675:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954709:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.954720:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.954730:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123136 00000100:00100000:1.0:1788581222.954733:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123136 00000100:00100000:1.0:1788581222.954823:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788581222.954832:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184123136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.954911:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184123136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.954923:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788581222.954958:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.955115:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10443:1875463184123264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.955147:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.955166:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123264 00000100:00100000:1.0:1788581222.955169:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123264 00000100:00100000:1.0:1788581222.955190:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788581222.955196:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10443:x1875463184123264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.955304:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10443:x1875463184123264:12345-0@lo:502:llog_process_th.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.955311:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788581222.955343:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.955355:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10443:1875463184123264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581222.955373:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581222.955382:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581222.955384:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581222.955391:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4f1e6000 00000020:00000080:1.0:1788581222.955394:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581222.957603:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10443:1875463184123392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.957670:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.957714:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123392 00000100:00100000:1.0:1788581222.957720:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123392 00000100:00100000:3.0:1788581222.957944:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788581222.957955:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10443:x1875463184123392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581222.958140:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:10443:x1875463184123392:12345-0@lo:502:llog_process_th.0 Request processed in 187us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.958148:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788581222.958237:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.958628:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10443:1875463184123392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581222.958677:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581222.958689:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581222.958692:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788581222.958696:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788581222.960570:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788581222.960600:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581222.960612:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.960625:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581222.960655:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581222.960657:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3a800 from 4 10000000:01000000:3.0:1788581222.960659:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581222.960693:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.960700:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581222.960710:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581222.960733:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581222.960866:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581222.960918:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.961497:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123520 00000100:00100000:1.0:1788581222.961506:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123520 00000100:00100000:1.0:1788581222.961557:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788581222.961567:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184123520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.961580:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581222.961593:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc4a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.961617:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.961627:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.961636:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b400, rc 0) 00000100:00100000:1.0:1788581222.961685:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184123520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.961692:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788581222.961737:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581222.961922:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.961933:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581222.961997:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.962036:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.962061:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.962075:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123648 00000100:00100000:1.0:1788581222.962079:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123648 00000100:00100000:1.0:1788581222.962114:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788581222.962120:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184123648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.962213:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184123648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.962220:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788581222.962247:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.962292:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.962327:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581222.962344:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.962354:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123776 00000100:00100000:1.0:1788581222.962357:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123776 00000100:00100000:1.0:1788581222.963565:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788581222.963578:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184123776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.963694:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184123776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.963701:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788581222.972382:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184123776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581222.979066:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10447:1875463184123904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.979143:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.984422:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581222.984773:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184123904 00000100:00100000:3.0:1788581222.984784:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184123904 00000100:00100000:3.0:1788581222.984873:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788581222.984883:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:10447:x1875463184123904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581222.985308:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:10447:x1875463184123904:12345-0@lo:502:llog_process_th.0 Request processed in 426us (6164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581222.985317:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788581222.986558:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10447:1875463184123904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581222.986600:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581222.986612:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581222.986614:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581222.986621:0:10447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4eb3a800 00000020:00000080:0.0:1788581222.986623:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581222.986711:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10447:1875463184124032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581222.986769:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581222.986802:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e43fa99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581222.986939:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124032 00000100:00100000:1.0:1788581222.986946:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124032 00000100:00100000:1.0:1788581222.986989:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788581222.986998:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:10447:x1875463184124032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581222.987124:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:10447:x1875463184124032:12345-0@lo:502:llog_process_th.0 Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581222.987132:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788581222.987490:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:10447:1875463184124032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581222.987515:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581222.987520:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581222.987522:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788581222.987526:0:10447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788581222.990234:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788581222.990292:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581222.990303:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581222.990315:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581223.105691:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581223.244429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581223.244517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581223.244606:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124160 00000100:00100000:2.0:1788581223.244615:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124160 00000100:00100000:2.0:1788581223.244662:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581223.244672:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184124160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581223.244701:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581223.245959:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184124160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1283us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581223.245969:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788581223.246091:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184124160:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581224.132278:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.155955:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581225.282387:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581225.282420:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581225.282487:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.282528:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124288 00000100:00100000:1.0:1788581225.282536:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124288 00000100:00100000:1.0:1788581225.282597:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581225.282607:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184124288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581225.282634:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581225.282680:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184124288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.282687:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788581225.282708:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581225.282732:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43361500 x1875463184124288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581225.282750:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581225.286535:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184124416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581225.286609:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.286811:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124416 00000100:00100000:1.0:1788581225.286819:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124416 00000100:00100000:1.0:1788581225.286889:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581225.286908:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184124416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581225.286935:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581225.286984:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184124416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.286990:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788581225.287012:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581225.287504:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432edf80 x1875463184124416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581225.287526:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184124416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581225.793544:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184124544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581225.794503:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581225.796904:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124544 00000100:00100000:3.0:1788581225.796919:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124544 00000100:00100000:3.0:1788581225.796981:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788581225.796991:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184124544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581225.797025:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581225.797100:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184124544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581225.797107:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788581225.797173:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184124544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581226.177721:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581226.963072:0:10668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788581227.201474:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581227.331602:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581227.331612:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184124800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581227.331870:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184125056:0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.332079:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184124928:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.334215:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.334448:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184125312:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.334488:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.334507:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184125824:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.334531:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.334553:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.334573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581227.334609:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.334618:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125312 00000100:00100000:2.0:1788581227.334626:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125312 00000100:00100000:3.0:1788581227.334650:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184125184:0@lo:400:kworker.0 00000100:00100000:0.0:1788581227.334658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581227.334686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581227.334709:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184125696:0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.334726:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581227.334769:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184125568:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.335094:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125056 00000100:00100000:2.0:1788581227.335099:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125056 00000100:00100000:2.0:1788581227.335130:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581227.335144:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.335199:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184125312:12345-0@lo:400:kworker.0 Request processed in 56us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.335206:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581227.335624:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581227.335636:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.335679:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184125056:12345-0@lo:400:kworker.0 Request processed in 47us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.335685:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581227.335708:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125824 00000100:00100000:2.0:1788581227.335712:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125824 00000100:00100000:2.0:1788581227.335744:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126336 00000100:00100000:2.0:1788581227.335746:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126336 00000100:00100000:2.0:1788581227.335763:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581227.335769:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184125824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.335804:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184125824:12345-0@lo:400:kworker.0 Request processed in 35us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.335822:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581227.335834:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581227.335839:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.335965:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126336:12345-0@lo:400:kworker.0 Request processed in 125us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.335971:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581227.335996:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125184 00000100:00100000:2.0:1788581227.336000:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125184 00000100:00100000:2.0:1788581227.336025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581227.336032:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.336066:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184125184:12345-0@lo:400:kworker.0 Request processed in 35us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.336072:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788581227.336091:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581227.336095:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581227.336134:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184125312:0@lo:400:kworker.0 00010000:00080000:2.0:1788581227.336149:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e5c00 x1875463184125824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581227.336161:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184125824:0@lo:400:kworker.0 00010000:00080000:2.0:1788581227.336172:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e5f80 x1875463184126336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581227.336180:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.336239:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124800 00000100:00100000:2.0:1788581227.336243:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124800 00000100:00100000:2.0:1788581227.336518:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124672 00000100:00100000:2.0:1788581227.336523:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124672 00000100:00100000:2.0:1788581227.336542:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581227.336549:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184124800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581227.336571:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581227.336610:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184124800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.336615:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581227.336627:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581227.336633:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184124672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581227.336642:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581227.336669:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184124672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.336675:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788581227.336692:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788581227.336713:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432edf80 x1875463184124800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581227.336722:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184126208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.336732:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184124800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581227.336758:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.336778:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125696 00000100:00100000:2.0:1788581227.336782:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125696 00010000:00080000:3.0:1788581227.336791:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b130a80 x1875463184124672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581227.336807:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581227.336812:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126208 00000100:00100000:2.0:1788581227.336817:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126208 00000100:00100000:3.0:1788581227.336834:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184125184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.336836:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581227.336845:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184125696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.336882:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788581227.336893:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184126208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.336900:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184125696:12345-0@lo:400:kworker.0 Request processed in 56us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.336910:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788581227.336937:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184126208:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581227.336939:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581227.336947:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788581227.336972:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13480 x1875463184125696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581227.336983:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184125696:0@lo:400:kworker.0 00010000:00080000:2.0:1788581227.336996:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e6300 x1875463184126208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581227.337006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.337010:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184126208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.337037:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184126080:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.337038:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125568 00000100:00100000:2.0:1788581227.337044:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125568 00000100:00100000:3.0:1788581227.337069:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581227.337110:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184125056:0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.337129:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126080 00000100:00100000:3.0:1788581227.337132:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126080 00000100:00100000:2.0:1788581227.337151:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788581227.337158:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581227.337163:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.337194:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184125440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.337207:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184125568:12345-0@lo:400:kworker.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.337214:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788581227.337362:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581227.337506:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184124928 00000100:00100000:2.0:1788581227.337511:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184124928 00000100:00100000:3.0:1788581227.337531:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581227.337540:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184126080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581227.337549:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788581227.337559:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.337585:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184126080:12345-0@lo:400:kworker.0 Request processed in 45us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.337592:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581227.337608:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184124928:12345-0@lo:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581227.337616:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788581227.337629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184125568:0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.337645:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184126080:0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.338520:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581227.338558:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184125952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.338585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581227.338600:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184126464:0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.338619:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581227.338650:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125952 00000100:00100000:1.0:1788581227.338655:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125952 00000100:00100000:3.0:1788581227.338664:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184125440 00000100:00100000:3.0:1788581227.338670:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184125440 00000100:00100000:1.0:1788581227.338702:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126464 00000100:00100000:1.0:1788581227.338706:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126464 00000100:00100000:3.0:1788581227.338710:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581227.338720:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184125440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.338737:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581227.338746:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184125952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581227.338765:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184125440:12345-0@lo:400:kworker.0 Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581227.338787:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184125952:12345-0@lo:400:kworker.0 Request processed in 42us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.338788:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581227.338799:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581227.338829:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581227.338849:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184126464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.338889:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184126464:12345-0@lo:400:kworker.0 Request processed in 46us (269us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581227.338958:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581227.341200:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e6d80 x1875463184126464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581227.341220:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184126464:0@lo:400:kworker.0 00000100:00100000:0.0:1788581227.341250:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184124928:0@lo:400:kworker.0 00000100:00100000:0.0:1788581227.341280:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184125440:0@lo:400:kworker.0 00010000:00080000:0.0:1788581227.341375:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4a80 x1875463184125952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581227.341384:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184125952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581227.346449:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581227.751729:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581227.751771:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581227.751802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581227.751934:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581227.752014:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581227.752055:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432512 00000100:00100000:3.0:1788581227.752067:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432512 00000100:00100000:3.0:1788581227.752138:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432384 00000100:00100000:3.0:1788581227.752142:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432384 00000100:00100000:3.0:1788581227.752172:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1788581227.752184:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581227.752297:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 115us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.752311:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1788581227.752331:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:3.0:1788581227.752339:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170432384:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581227.752367:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170432384:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.752375:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1788581227.752388:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432256 00000100:00100000:1.0:1788581227.752396:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432256 00000100:00100000:3.0:1788581227.752427:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432768 00000100:00100000:3.0:1788581227.752433:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432768 00000100:00100000:1.0:1788581227.752443:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 275 00000100:00100000:1.0:1788581227.752453:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170432256:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581227.752465:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432640 00000100:00100000:3.0:1788581227.752470:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432640 00000100:00100000:1.0:1788581227.752490:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170432256:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.752502:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1788581227.752503:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 275 00000100:00100000:3.0:1788581227.752517:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432768:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581227.752570:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432768:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 56us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.752579:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1788581227.752599:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581227.752607:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432640:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581227.752636:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170432640:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581227.752643:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00080000:3.0:1788581227.752688:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581227.752694:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581227.752697:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581227.752701:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788581228.227020:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581228.357318:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184126592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581228.357417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581228.357594:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126592 00000100:00100000:0.0:1788581228.357605:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126592 00000100:00100000:0.0:1788581228.357670:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581228.357682:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184126592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581228.357726:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581228.357783:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184126592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581228.357791:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581228.357886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184126592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581229.249853:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581230.274401:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581230.402063:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581230.402085:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184126720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581230.402151:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581230.402214:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126720 00000100:00100000:3.0:1788581230.402221:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126720 00000100:00100000:3.0:1788581230.402307:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581230.402317:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184126720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581230.402345:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581230.402388:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184126720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581230.402406:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788581230.402427:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581230.402500:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581230.402532:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788581230.402863:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363100 x1875463184126720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581230.402895:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184126720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581230.402921:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126848 00000100:00100000:3.0:1788581230.402925:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126848 00000100:00100000:3.0:1788581230.402994:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581230.403000:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581230.403013:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581230.403050:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581230.403055:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788581230.403084:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432eca80 x1875463184126848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581230.403096:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126848:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581230.403968:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581230.923342:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581230.927526:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581230.927610:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581230.927720:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184126976 00000100:00100000:3.0:1788581230.927728:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184126976 00000100:00100000:3.0:1788581230.927779:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581230.927789:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581230.927823:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581230.927889:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184126976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581230.927896:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581230.927942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184126976:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581231.297505:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581231.620082:0:10911:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing yml_node 00010000:00010000:1.0:1788581232.322496:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581232.449899:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184127104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581232.449964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.450045:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127104 00000100:00100000:3.0:1788581232.450053:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127104 00000100:00100000:3.0:1788581232.450116:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788581232.450125:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184127104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581232.450154:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581232.450197:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184127104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.450204:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788581232.450223:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581232.450250:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363100 x1875463184127104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581232.450282:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184127104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581232.450508:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184127232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581232.450538:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581232.450568:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127232 00000100:00100000:0.0:1788581232.450572:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127232 00000100:00100000:0.0:1788581232.450599:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581232.450606:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184127232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581232.450617:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581232.450647:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184127232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581232.450663:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788581232.450677:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581232.450694:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7b80 x1875463184127232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581232.450707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184127232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581232.451274:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184127360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581232.451310:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581232.453972:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184127488:0@lo:400:kworker.0 00000100:00100000:1.0:1788581232.454039:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581232.454101:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127488 00000100:00100000:1.0:1788581232.454108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127488 00000100:00100000:1.0:1788581232.454150:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581232.454158:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184127488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581232.454208:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184127488:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581232.454216:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581232.454295:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184127488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455573:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127360 00000100:00100000:3.0:1788581232.455578:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127360 00000100:00100000:3.0:1788581232.455613:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788581232.455621:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184127360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455675:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184127360:12345-0@lo:400:kworker.0 Request processed in 54us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.455681:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788581232.455713:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184127744:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455754:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.455776:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184128256:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.455833:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788581232.455839:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184127616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455861:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.455886:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184128128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455906:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.455921:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184128640:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.455938:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581232.455960:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127744 00000100:00100000:3.0:1788581232.455964:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127744 00000100:00100000:3.0:1788581232.455985:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128128 00000100:00100000:3.0:1788581232.455987:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128128 00000100:00100000:3.0:1788581232.456006:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128640 00000100:00100000:3.0:1788581232.456009:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128640 00000100:00100000:3.0:1788581232.456021:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581232.456027:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184127744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.456058:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184127744:12345-0@lo:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581232.456357:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127616 00000100:00100000:2.0:1788581232.456362:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127616 00000100:00100000:2.0:1788581232.456390:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581232.456397:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184127616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456435:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184127616:12345-0@lo:400:kworker.0 Request processed in 39us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581232.456442:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581232.456473:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184127872:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581232.456516:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184128384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456534:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581232.456562:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184127360:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456578:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581232.456583:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184128000:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456604:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581232.456614:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184128512:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456632:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581232.456651:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184127872 00000100:00100000:2.0:1788581232.456654:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184127872 00000100:00100000:2.0:1788581232.456677:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581232.456683:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184127872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.456746:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184127872:12345-0@lo:400:kworker.0 Request processed in 63us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581232.456758:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581232.456787:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184127872:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.456943:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581232.456955:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128000 00000100:00100000:3.0:1788581232.456958:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128000 00000100:00100000:3.0:1788581232.456973:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128512 00000100:00100000:3.0:1788581232.456975:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128512 00000100:00100000:3.0:1788581232.456987:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788581232.456993:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184128128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457026:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184128128:12345-0@lo:400:kworker.0 Request processed in 33us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457032:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788581232.457043:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788581232.457049:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457073:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184128640:12345-0@lo:400:kworker.0 Request processed in 24us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457088:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788581232.457099:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788581232.457105:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184128000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457144:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184128000:12345-0@lo:400:kworker.0 Request processed in 39us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457150:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788581232.457160:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581232.457166:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457190:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184128512:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457196:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581232.457212:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128256 00000100:00100000:3.0:1788581232.457216:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128256 00000100:00100000:3.0:1788581232.457237:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128384 00000100:00100000:3.0:1788581232.457240:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128384 00000100:00100000:3.0:1788581232.457275:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581232.457282:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184128256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457311:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184128256:12345-0@lo:400:kworker.0 Request processed in 29us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457316:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581232.457326:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581232.457332:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184128384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457354:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184128384:12345-0@lo:400:kworker.0 Request processed in 22us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.457360:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788581232.457391:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581232.457396:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581232.457398:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581232.457420:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184127616:0@lo:400:kworker.0 00010000:00080000:3.0:1788581232.457432:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf100 x1875463184128128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581232.457443:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184128128:0@lo:400:kworker.0 00010000:00080000:3.0:1788581232.457452:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ae680 x1875463184128640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581232.457460:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184128640:0@lo:400:kworker.0 00000100:00100000:3.0:1788581232.457471:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184127744:0@lo:400:kworker.0 00010000:00080000:3.0:1788581232.457479:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facce00 x1875463184128256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581232.457488:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184128256:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.457576:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184128000:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.457585:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184128512:0@lo:400:kworker.0 00010000:00080000:2.0:1788581232.457597:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423aed80 x1875463184128384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581232.457603:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184128384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581232.880193:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581232.880242:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581232.880301:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581232.880336:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581232.880363:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581232.880398:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433408 00000100:00100000:0.0:1788581232.880407:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433408 00000100:00100000:1.0:1788581232.880433:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170432896 00000100:00100000:1.0:1788581232.880437:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170432896 00000100:00100000:0.0:1788581232.880469:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433280 00000100:00100000:0.0:1788581232.880472:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433280 00000100:00100000:1.0:1788581232.880473:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 277 00000100:00100000:0.0:1788581232.880492:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1788581232.880494:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2394:x1875463170432896:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581232.880499:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581232.880559:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2394:x1875463170432896:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (376us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581232.880563:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581232.880566:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 277 00000100:00080000:2.0:1788581232.880567:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581232.880596:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1788581232.880604:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581232.880654:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433152 00000100:00100000:3.0:1788581232.880658:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433152 00000100:00100000:3.0:1788581232.880703:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433024 00000100:00100000:3.0:1788581232.880706:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433024 00000100:00100000:3.0:1788581232.880729:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1788581232.880746:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433152:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581232.880751:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 253us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581232.880768:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1788581232.880775:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433152:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.880781:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1788581232.880793:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1788581232.880806:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170433024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581232.880855:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170433024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 49us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581232.880861:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00080000:1.0:1788581232.881004:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581232.881008:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581232.881484:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170433280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 880us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581232.881492:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00010000:00010000:0.0:1788581233.349577:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581233.473790:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184128768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581233.473877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581233.474028:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128768 00000100:00100000:2.0:1788581233.474038:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128768 00000100:00100000:2.0:1788581233.474094:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581233.474104:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184128768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581233.474138:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581233.482892:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184128768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8780us (9005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581233.482908:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788581233.483078:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184128768:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581234.370026:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581235.394313:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581235.523206:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184128896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581235.523282:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581235.523347:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184128896 00000100:00100000:3.0:1788581235.523353:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184128896 00000100:00100000:3.0:1788581235.523414:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581235.523424:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184128896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581235.523451:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581235.523496:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184128896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581235.523503:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788581235.524287:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581235.524758:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184129024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581235.524815:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788581235.525024:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423ac380 x1875463184128896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581235.525045:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184128896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581235.525962:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129024 00000100:00100000:0.0:1788581235.525969:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129024 00000100:00100000:0.0:1788581235.526163:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581235.526175:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184129024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581235.526198:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788581235.527473:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581235.530430:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184129024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4249us (5615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581235.530459:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788581235.532488:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b131180 x1875463184129024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581235.532517:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184129024:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788581235.749012:0:11095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:0.0:1788581236.034643:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581236.034666:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184129152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581236.034735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581236.034926:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129152 00000100:00100000:3.0:1788581236.034935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129152 00000100:00100000:3.0:1788581236.034986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581236.034996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184129152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581236.035043:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581236.035100:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184129152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581236.035107:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581236.035182:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184129152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788581236.422702:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581237.443374:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581237.569747:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184129280:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.569838:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.569905:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129280 00000100:00100000:2.0:1788581237.569913:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129280 00000100:00100000:2.0:1788581237.569957:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788581237.569966:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184129280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.570014:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184129280:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.570021:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788581237.570067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184129280:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.570426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184129664:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.570462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.570547:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.570576:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.570598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184130304:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.570620:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.570636:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184130816:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.570657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.570690:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129792 00000100:00100000:2.0:1788581237.570695:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129792 00000100:00100000:2.0:1788581237.570724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581237.570732:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.570817:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184129792:12345-0@lo:400:kworker.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.570824:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581237.570853:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184129792:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.571006:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184130176:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.571030:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.571057:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184130688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.571078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.571108:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184129408:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.571132:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581237.571167:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130304 00000100:00100000:2.0:1788581237.571172:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130304 00000100:00100000:2.0:1788581237.571200:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130816 00000100:00100000:2.0:1788581237.571203:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130816 00000100:00100000:2.0:1788581237.571215:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130176 00000100:00100000:2.0:1788581237.571217:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130176 00000100:00100000:2.0:1788581237.571228:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130688 00000100:00100000:2.0:1788581237.571231:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130688 00000100:00100000:2.0:1788581237.571244:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581237.571250:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184130304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.571304:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184130304:12345-0@lo:400:kworker.0 Request processed in 54us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.571311:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581237.571323:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581237.571329:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184130816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.571357:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184130816:12345-0@lo:400:kworker.0 Request processed in 28us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.571363:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581237.571375:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581237.571381:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184130176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.571425:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184130176:12345-0@lo:400:kworker.0 Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.571431:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581237.571451:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581237.571456:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184130688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.571484:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184130688:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.571489:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788581237.571503:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581237.571507:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581237.571525:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facc380 x1875463184130304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581237.571536:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184130304:0@lo:400:kworker.0 00010000:00080000:2.0:1788581237.571545:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf100 x1875463184130816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581237.571554:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184130816:0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.574298:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184129536:0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.574366:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581237.574405:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184130048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.574481:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129536 00000100:00100000:2.0:1788581237.574488:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129536 00000100:00100000:2.0:1788581237.574542:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581237.574553:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184129536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.574620:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184129536:12345-0@lo:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581237.574627:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581237.575044:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184129920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.575074:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581237.575164:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129664 00000100:00100000:1.0:1788581237.575169:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129664 00000100:00100000:0.0:1788581237.575295:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129408 00000100:00100000:0.0:1788581237.575299:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129408 00000100:00100000:0.0:1788581237.575325:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581237.575332:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184129664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.575370:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184129664:12345-0@lo:400:kworker.0 Request processed in 38us (4908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581237.575377:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581237.575391:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788581237.575397:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184129408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.575425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184129408:12345-0@lo:400:kworker.0 Request processed in 28us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581237.575431:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581237.580594:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184130432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.581056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.581189:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184130944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581237.581229:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.581330:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184129408:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.581444:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184129664:0@lo:400:kworker.0 00010000:00080000:3.0:1788581237.581472:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facfb80 x1875463184130176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581237.581517:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184130176:0@lo:400:kworker.0 00010000:00080000:3.0:1788581237.581547:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facce00 x1875463184130688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581237.581557:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184130688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581237.581779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184129920 00000100:00100000:2.0:1788581237.581785:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184129920 00000100:00100000:0.0:1788581237.585815:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130432 00000100:00100000:0.0:1788581237.585827:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130432 00000100:00100000:0.0:1788581237.585876:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581237.585886:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184129920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.585989:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184129920:12345-0@lo:400:kworker.0 Request processed in 105us (10914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581237.586008:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581237.586026:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581237.586033:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184130432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581237.586066:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184130432:12345-0@lo:400:kworker.0 Request processed in 34us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581237.586072:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581237.586214:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130944 00000100:00100000:3.0:1788581237.586219:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130944 00000100:00100000:3.0:1788581237.586275:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581237.586283:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184130944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581237.586306:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581237.586344:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184130944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581237.586350:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581237.586372:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.586404:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184130560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.586433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.586450:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184131072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581237.586511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581237.586584:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184129536:0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.586629:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131072 00000100:00100000:3.0:1788581237.586633:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131072 00000100:00100000:3.0:1788581237.586656:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581237.586663:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184131072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581237.586673:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581237.586725:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184131072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581237.586740:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788581237.586772:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf100 x1875463184131072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581237.586879:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184131072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581237.587104:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130048 00000100:00100000:3.0:1788581237.587109:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130048 00000100:00100000:3.0:1788581237.587148:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184130560 00000100:00100000:3.0:1788581237.587151:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184130560 00000100:00100000:3.0:1788581237.587184:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581237.587204:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184130048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.587285:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184130048:12345-0@lo:400:kworker.0 Request processed in 63us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581237.587308:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581237.587322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581237.587328:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184130560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581237.587385:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184130560:12345-0@lo:400:kworker.0 Request processed in 57us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581237.587391:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788581237.587420:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facca80 x1875463184130048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581237.587430:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184130048:0@lo:400:kworker.0 00010000:00080000:3.0:1788581237.587441:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facdf80 x1875463184130560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581237.587449:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184130560:0@lo:400:kworker.0 00000100:00080000:2.0:1788581237.588197:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581237.588202:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581237.589023:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e5c00 x1875463184130944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581237.589046:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184130944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581237.589063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184129920:0@lo:400:kworker.0 00000100:00100000:1.0:1788581237.589073:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184130432:0@lo:400:kworker.0 00000001:02000400:2.0:1788581237.897962:0:11192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:1.0:1788581238.007140:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581238.007184:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581238.007217:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581238.007309:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433536 00000100:00100000:0.0:1788581238.007320:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433536 00000100:00100000:1.0:1788581238.008614:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433792 00000100:00100000:1.0:1788581238.008624:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433792 00000100:00100000:1.0:1788581238.008689:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433664 00000100:00100000:1.0:1788581238.008693:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433664 00000100:00100000:1.0:1788581238.008720:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:1.0:1788581238.008731:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170433792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581238.008773:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:0.0:1788581238.008785:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2393:x1875463170433536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581238.008843:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2393:x1875463170433536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 60us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581238.008851:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:0.0:1788581238.008890:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:1.0:1788581238.008903:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170433792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 170us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581238.008904:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2393:x1875463170433664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581238.008920:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:0.0:1788581238.008942:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2393:x1875463170433664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 44us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581238.008950:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00080000:1.0:1788581238.008956:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581238.008961:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581238.012143:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581238.012192:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581238.012360:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170433920 00000100:00100000:0.0:1788581238.012369:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170433920 00000100:00100000:0.0:1788581238.012712:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434048 00000100:00100000:0.0:1788581238.012716:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434048 00000100:00100000:0.0:1788581238.012745:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1788581238.012756:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2392:x1875463170433920:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:0.0:1788581238.012787:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb63 00000100:00080000:0.0:1788581238.012813:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581238.012857:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788581238.012993:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+2:2392:x1875463170433920:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 238us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581238.013002:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1788581238.013021:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1788581238.013028:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2392:x1875463170434048:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:0.0:1788581238.013055:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb6a 00000100:00080000:0.0:1788581238.013061:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581238.013083:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788581238.013153:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+2:2392:x1875463170434048:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 126us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581238.013159:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00080000:0.0:1788581238.013176:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581238.013180:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581238.013191:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581238.013196:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581238.465433:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581238.594323:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581238.594392:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581238.594481:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131200 00000100:00100000:1.0:1788581238.594488:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131200 00000100:00100000:1.0:1788581238.594543:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581238.594553:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581238.594596:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581238.594643:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581238.594651:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581238.594692:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131200:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581239.489648:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581240.516786:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581240.611813:0:11290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:1.0:1788581240.644153:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581240.644185:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581240.644297:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581240.644458:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131328 00000100:00100000:3.0:1788581240.644468:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131328 00000100:00100000:3.0:1788581240.644543:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581240.644557:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131328:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581240.644564:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788581240.644595:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581240.644671:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581240.644679:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788581240.644706:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4225bb80 x1875463184131328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581240.644742:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581240.644874:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184131456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581240.644905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581240.646214:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131456 00000100:00100000:3.0:1788581240.646227:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131456 00000100:00100000:3.0:1788581240.646318:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581240.646329:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184131456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581240.646356:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788581240.646474:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581240.650977:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184131456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4636us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581240.650997:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788581240.651515:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facc380 x1875463184131456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581240.651544:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184131456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581241.157593:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7face300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184131584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581241.157705:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581241.157914:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131584 00000100:00100000:2.0:1788581241.157943:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131584 00000100:00100000:2.0:1788581241.158018:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788581241.158030:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184131584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581241.158077:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788581241.158146:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184131584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581241.158154:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581241.158675:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7face300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184131584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788581241.537429:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581242.168024:0:11338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 00:07:20 EDT 2026 00010000:00010000:0.0:1788581242.561502:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581242.689573:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581242.689657:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581242.689832:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131712 00000100:00100000:0.0:1788581242.689841:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131712 00000100:00100000:0.0:1788581242.689905:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581242.689916:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581242.689945:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581242.690025:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184131712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581242.690033:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788581242.690063:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7480 x1875463184131712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581242.690083:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184131712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581242.690200:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788581242.690205:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581242.690210:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184131840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581242.690279:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581242.690375:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131840 00000100:00100000:2.0:1788581242.690381:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131840 00000100:00100000:2.0:1788581242.690426:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581242.690436:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184131840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581242.690449:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581242.690452:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184132224:0@lo:400:kworker.0 00000100:00100000:2.0:1788581242.690497:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184131840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.690498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581242.690509:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581242.690525:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184132736:0@lo:400:kworker.0 00000100:00080000:2.0:1788581242.690528:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581242.690551:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581242.690583:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184133248:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.690590:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184131968:0@lo:400:kworker.0 00000100:00100000:2.0:1788581242.690663:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132736 00000100:00100000:2.0:1788581242.690668:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132736 00000100:00100000:2.0:1788581242.690709:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581242.690717:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.690729:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.690756:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581242.691052:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788581242.691082:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4225b480 x1875463184131840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581242.691098:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184131840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581242.691120:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788581242.691127:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184132352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691204:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581242.691223:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184132864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691245:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581242.691298:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133248 00000100:00100000:1.0:1788581242.691302:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133248 00000100:00100000:1.0:1788581242.691323:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132352 00000100:00100000:1.0:1788581242.691326:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132352 00000100:00100000:1.0:1788581242.691339:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581242.691346:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184133248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691382:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184133248:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.691388:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581242.691401:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581242.691407:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184132352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691432:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184132352:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.691438:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581242.691462:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184132352:0@lo:400:kworker.0 00010000:00080000:1.0:1788581242.691472:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad3480 x1875463184133248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581242.691481:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691560:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184131968 00000100:00100000:1.0:1788581242.691564:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184131968 00000100:00100000:1.0:1788581242.691600:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788581242.691606:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184131968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691639:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184131968:12345-0@lo:400:kworker.0 Request processed in 32us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.691645:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788581242.691683:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132864 00000100:00100000:1.0:1788581242.691687:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132864 00000100:00100000:1.0:1788581242.691713:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581242.691721:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581242.691770:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184132736:12345-0@lo:400:kworker.0 Request processed in 1044us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.691777:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184132864:12345-0@lo:400:kworker.0 Request processed in 55us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581242.691783:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788581242.691790:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788581242.691807:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581242.691818:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788581242.691844:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad0e00 x1875463184132864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581242.691855:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184132864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691862:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132224 00000100:00100000:1.0:1788581242.691868:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132224 00010000:00080000:2.0:1788581242.691870:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad1180 x1875463184132736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581242.691881:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184132736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691902:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581242.691912:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184132224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581242.691948:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184132224:12345-0@lo:400:kworker.0 Request processed in 39us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581242.691954:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788581242.692037:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581242.692063:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692082:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581242.692097:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184133120:0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692124:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581242.692239:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132096 00000100:00100000:3.0:1788581242.692243:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132096 00000100:00100000:3.0:1788581242.692282:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132608 00000100:00100000:3.0:1788581242.692286:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132608 00000100:00100000:3.0:1788581242.692305:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133120 00000100:00100000:3.0:1788581242.692308:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133120 00000100:00100000:3.0:1788581242.692322:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788581242.692327:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184132096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692362:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184132096:12345-0@lo:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581242.692368:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788581242.692381:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788581242.692387:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184132608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692413:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184132608:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581242.692419:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788581242.692430:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788581242.692435:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184133120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692457:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184133120:12345-0@lo:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581242.692463:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788581242.692476:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581242.692495:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184132096:0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692503:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.692511:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184133120:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.695875:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184131968:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.695890:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.695943:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581242.695964:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184132992:0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.695982:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581242.696034:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132992 00000100:00100000:0.0:1788581242.696040:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132992 00000100:00100000:0.0:1788581242.696085:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581242.696092:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184132992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581242.696138:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184132992:12345-0@lo:400:kworker.0 Request processed in 46us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581242.696145:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788581242.696164:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581242.696182:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad0700 x1875463184132992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581242.696194:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184132992:0@lo:400:kworker.0 00000100:00100000:2.0:1788581242.696307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184132224:0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.698479:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184132480 00000100:00100000:3.0:1788581242.698492:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184132480 00000100:00100000:3.0:1788581242.698557:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788581242.698568:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184132480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581242.698655:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184132480:12345-0@lo:400:kworker.0 Request processed in 90us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581242.698663:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581242.701744:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581243.118950:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581243.119000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581243.119026:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434176 00000100:00100000:0.0:1788581243.119045:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434176 00000100:00100000:0.0:1788581243.119093:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1788581243.119103:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170434176:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581243.119167:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170434176:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581243.119174:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1788581243.119222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581243.119320:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434304 00000100:00100000:2.0:1788581243.119325:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434304 00000100:00100000:2.0:1788581243.119364:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434432 00000100:00100000:2.0:1788581243.119367:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434432 00000100:00100000:2.0:1788581243.119387:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1788581243.119396:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170434304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581243.119430:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170434304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581243.119437:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1788581243.119450:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:2.0:1788581243.119456:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170434432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581243.119479:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170434432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581243.119485:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00080000:2.0:1788581243.119505:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581243.119509:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581243.587075:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581243.715845:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581243.715868:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184133376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581243.715944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581243.716008:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133376 00000100:00100000:0.0:1788581243.716015:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133376 00000100:00100000:0.0:1788581243.716053:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581243.716060:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184133376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581243.716090:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581243.716128:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184133376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581243.716134:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581243.716170:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184133376:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788581243.721456:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:00100000:0.0:1788581243.721528:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:0.0:1788581243.721536:0:9486:0:(genops.c:885:class_export_put()) final put ffff995e7fa4e000/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581243.722013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4e000/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-OST0001 00000020:00000080:3.0:1788581243.722066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa4d800 for lustre-OST0001 00000020:00000080:2.0:1788581243.723804:0:8400:0:(genops.c:885:class_export_put()) final put ffff995e7fa4f800/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:0.0:1788581243.723851:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4f800/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-OST0000 00000020:00000080:0.0:1788581243.723900:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa4c000 for lustre-OST0000 00010000:00010000:3.0:1788581244.609761:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581245.633440:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581245.763431:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184133504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581245.763532:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581245.763728:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133504 00000100:00100000:1.0:1788581245.763738:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133504 00000100:00100000:1.0:1788581245.763813:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581245.763824:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184133504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581245.763853:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581245.763899:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184133504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581245.763907:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581245.764537:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184133632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581245.764575:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581245.764666:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581245.764699:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad3480 x1875463184133504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581245.764719:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184133504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581245.764796:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133632 00000100:00100000:2.0:1788581245.764802:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133632 00000100:00100000:2.0:1788581245.764849:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788581245.764857:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184133632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581245.764871:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581245.764916:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184133632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581245.764923:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788581245.765027:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6faced80 x1875463184133632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581245.765038:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184133632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788581245.765268:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581246.274289:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184133760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581246.274375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581246.274986:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133760 00000100:00100000:2.0:1788581246.274997:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133760 00000100:00100000:2.0:1788581246.275056:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788581246.275067:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184133760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581246.275098:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788581246.277112:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184133760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2041us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581246.277135:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581246.277285:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184133760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581246.657506:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581247.681402:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581247.809560:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581247.809580:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184133888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581247.809643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581247.809699:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184133888 00000100:00100000:1.0:1788581247.809705:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184133888 00000100:00100000:1.0:1788581247.809770:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581247.809779:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184133888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788581247.809809:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581247.809858:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184133888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.809865:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788581247.809884:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad3b80 x1875463184133888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581247.809889:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581247.809907:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184133888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581247.809933:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581247.809945:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184134016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581247.809991:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810079:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581247.810103:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184134528:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810140:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184134272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810148:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581247.810178:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810180:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184134144:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810204:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184134784:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810216:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810247:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184135040:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810290:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581247.810317:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184135296:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810327:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581247.810336:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184134656:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810346:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581247.810382:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788581247.810383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581247.810393:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184134400:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810410:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184135168:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810426:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810439:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581247.810452:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184134912:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810474:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134528 00000100:00100000:3.0:1788581247.810480:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810480:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134528 00000100:00100000:3.0:1788581247.810497:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184135424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810508:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134272 00000100:00100000:2.0:1788581247.810512:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134272 00000100:00100000:3.0:1788581247.810521:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581247.810529:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134784 00000100:00100000:2.0:1788581247.810534:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134784 00000100:00100000:3.0:1788581247.810547:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135296 00000100:00100000:3.0:1788581247.810552:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135296 00000100:00100000:2.0:1788581247.810555:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134912 00000100:00100000:2.0:1788581247.810560:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134912 00000100:00100000:3.0:1788581247.810584:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135424 00000100:00100000:3.0:1788581247.810589:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135424 00000100:00100000:2.0:1788581247.810590:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581247.810601:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.810613:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581247.810623:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184134272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810652:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184134528:12345-0@lo:400:kworker.0 Request processed in 52us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581247.810660:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788581247.810672:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184134272:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581247.810679:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788581247.810858:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184134784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.810896:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184134784:12345-0@lo:400:kworker.0 Request processed in 210us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.810913:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134016 00000100:00100000:1.0:1788581247.810918:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134016 00000100:00100000:1.0:1788581247.810960:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581247.810968:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788581247.810969:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184134016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581247.810980:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00002000:00000024:1.0:1788581247.810986:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581247.811022:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184134016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.811029:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581247.811052:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134144 00010000:00080000:0.0:1788581247.811053:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43816680 x1875463184134016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581247.811057:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134144 00000100:00100000:0.0:1788581247.811075:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184134016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581247.811090:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788581247.811097:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184134144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581247.811131:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184134144:12345-0@lo:400:kworker.0 Request processed in 35us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.811137:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788581247.811170:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135040 00000100:00100000:1.0:1788581247.811173:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135040 00000100:00100000:1.0:1788581247.811200:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135168 00000100:00100000:1.0:1788581247.811203:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135168 00000100:00100000:1.0:1788581247.811221:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581247.811227:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184135040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581247.811273:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184135040:12345-0@lo:400:kworker.0 Request processed in 46us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.811279:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581247.811290:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581247.811295:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184135168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581247.811322:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184135168:12345-0@lo:400:kworker.0 Request processed in 27us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581247.811327:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788581247.811350:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581247.811353:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581247.811355:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581247.811357:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581247.814245:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581247.814347:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581247.814366:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184135296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.814454:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184135296:12345-0@lo:400:kworker.0 Request processed in 98us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581247.814843:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581247.814860:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788581247.814870:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184134912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.814907:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184134912:12345-0@lo:400:kworker.0 Request processed in 41us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581247.814912:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788581247.814939:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788581247.814945:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184135424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.814987:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184135424:12345-0@lo:400:kworker.0 Request processed in 42us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581247.814992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788581247.815025:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134656 00000100:00100000:3.0:1788581247.815033:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134656 00000100:00100000:3.0:1788581247.815081:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184134400 00000100:00100000:3.0:1788581247.815084:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184134400 00000100:00100000:3.0:1788581247.815098:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788581247.815104:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.815148:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184134656:12345-0@lo:400:kworker.0 Request processed in 43us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581247.815154:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788581247.815166:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788581247.815172:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.815199:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184134400:12345-0@lo:400:kworker.0 Request processed in 27us (4774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581247.815204:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788581247.815355:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184134400:0@lo:400:kworker.0 00010000:00080000:3.0:1788581247.815372:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facc700 x1875463184134912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581247.815382:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184134912:0@lo:400:kworker.0 00010000:00080000:3.0:1788581247.815392:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faced80 x1875463184135424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581247.815413:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184135424:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.815427:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184134272:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.815438:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788581247.815448:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184135296:0@lo:400:kworker.0 00000100:00100000:0.0:1788581247.817306:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184134656:0@lo:400:kworker.0 00010000:00080000:0.0:1788581247.817327:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facf480 x1875463184135168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581247.817339:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184135168:0@lo:400:kworker.0 00010000:00080000:0.0:1788581247.817351:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facf800 x1875463184135040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581247.817372:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184135040:0@lo:400:kworker.0 00000100:00100000:0.0:1788581247.817393:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184134528:0@lo:400:kworker.0 00000100:00100000:0.0:1788581247.817405:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184134144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581247.818004:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581248.236478:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581248.236521:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581248.236545:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581248.236569:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434816 00000100:00100000:0.0:1788581248.236578:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434816 00000100:00100000:0.0:1788581248.236642:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434688 00000100:00100000:0.0:1788581248.236645:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434688 00000100:00100000:0.0:1788581248.236667:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:0.0:1788581248.236676:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170434816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581248.236754:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170434816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581248.236784:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:0.0:1788581248.236800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:0.0:1788581248.236818:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170434688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581248.236843:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170434688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581248.236848:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00080000:0.0:1788581248.236867:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581248.236871:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581248.237189:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434560 00000100:00100000:1.0:1788581248.237194:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434560 00000100:00100000:1.0:1788581248.237231:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:1.0:1788581248.237238:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170434560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581248.237293:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2396:x1875463170434560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581248.237299:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 283 00010000:00010000:0.0:1788581248.709149:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581248.833539:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581248.833570:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184135552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581248.833632:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581248.835512:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135552 00000100:00100000:3.0:1788581248.835524:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135552 00000100:00100000:3.0:1788581248.835581:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788581248.835589:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184135552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581248.835622:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581248.835699:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184135552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581248.835706:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581248.836680:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184135552:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581249.733074:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581250.754833:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581250.882952:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581250.882972:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184135680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581250.883035:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581250.883448:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135680 00000100:00100000:2.0:1788581250.883456:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135680 00000100:00100000:3.0:1788581250.883519:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184135808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581250.883524:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581250.883533:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184135680:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581250.883546:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788581250.883570:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581250.883578:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135808 00000100:00100000:3.0:1788581250.883580:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135808 00000100:00100000:3.0:1788581250.883599:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581250.883605:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184135808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581250.883612:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184135680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (578us total) trans 0 rc 0/0 00002000:00000024:3.0:1788581250.883616:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581250.883625:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788581250.883644:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184135808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581250.883657:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788581250.883685:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814a80 x1875463184135808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581250.883701:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184135808:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788581250.883726:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad6300 x1875463184135680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581250.883739:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184135680:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581250.884236:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581251.394519:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581251.394542:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184135936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581251.394608:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581251.394715:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184135936 00000100:00100000:0.0:1788581251.394722:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184135936 00000100:00100000:0.0:1788581251.394774:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788581251.394784:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184135936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581251.394817:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581251.394863:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184135936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581251.394871:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788581251.394993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184135936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581251.778882:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581252.801623:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581252.931923:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.931990:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581252.934047:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184136192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581252.934230:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581252.934635:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136192 00000100:00100000:1.0:1788581252.934643:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136192 00000100:00100000:1.0:1788581252.934687:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581252.934849:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581252.934907:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184136192:12345-0@lo:400:kworker.0 Request processed in 212us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581252.934914:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581252.935029:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184136192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581252.935674:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136064 00000100:00100000:1.0:1788581252.935681:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136064 00000100:00100000:1.0:1788581252.935800:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788581252.935810:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184136064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.940510:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184136320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581252.940575:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581252.940608:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581252.940614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184136448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581252.940634:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581252.940666:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136320 00000100:00100000:0.0:1788581252.940673:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136320 00000100:00100000:0.0:1788581252.940738:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136448 00000100:00100000:0.0:1788581252.940742:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136448 00000100:00100000:0.0:1788581252.940759:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581252.940769:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184136320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581252.940796:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581252.940847:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184136320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.940854:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581252.940874:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788581252.940881:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184136448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581252.940890:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581252.940915:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184136448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.940920:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788581252.940940:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581252.940968:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43817100 x1875463184136448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581252.940987:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184136448:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788581252.941013:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43817b80 x1875463184136320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581252.941025:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184136320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581252.941291:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184136064:12345-0@lo:400:kworker.0 Request processed in 5480us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581252.941302:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788581252.943717:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184136064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581252.951299:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581252.951323:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184136576:0@lo:400:kworker.0 00000100:00100000:3.0:1788581252.951388:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.951504:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184136704:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.951539:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.951571:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184137216:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.951597:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.951716:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788581252.951724:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184137088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.951749:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.951770:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184137600:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.951793:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.951824:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137216 00000100:00100000:2.0:1788581252.951830:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137216 00000100:00100000:2.0:1788581252.951898:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581252.951909:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184137216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.951960:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184137216:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581252.951967:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581252.951997:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136704 00000100:00100000:2.0:1788581252.952001:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136704 00000100:00100000:2.0:1788581252.952023:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137088 00000100:00100000:2.0:1788581252.952026:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137088 00000100:00100000:2.0:1788581252.952044:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137600 00000100:00100000:2.0:1788581252.952047:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137600 00000100:00100000:2.0:1788581252.952063:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788581252.952069:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184136704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581252.952106:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581252.952185:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184136704:12345-0@lo:400:kworker.0 Request processed in 114us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581252.952193:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788581252.952209:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581252.952216:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184137600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.952246:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184137600:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581252.952284:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184137088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.952291:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788581252.952328:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184137088:12345-0@lo:400:kworker.0 Request processed in 202us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581252.952335:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788581252.952551:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad5180 x1875463184137088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581252.952564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184137088:0@lo:400:kworker.0 00010000:00080000:2.0:1788581252.952573:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad5880 x1875463184137600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581252.952580:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184137600:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.952587:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184136704:0@lo:400:kworker.0 00010000:00080000:2.0:1788581252.952596:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad4e00 x1875463184137216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581252.952772:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184137216:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954468:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136576 00000100:00100000:0.0:1788581252.954482:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136576 00000100:00100000:0.0:1788581252.954546:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581252.954555:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184136576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954650:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184136576:12345-0@lo:400:kworker.0 Request processed in 96us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.954657:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581252.954684:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184136832:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954742:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581252.954773:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184137344:0@lo:400:kworker.0 00000100:00100000:2.0:1788581252.954777:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136832 00000100:00100000:2.0:1788581252.954783:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136832 00000100:00100000:0.0:1788581252.954801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581252.954819:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581252.954828:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184136832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954832:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788581252.954840:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184136960:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954865:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581252.954885:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184137472:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.954903:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581252.954935:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184136960 00000100:00100000:0.0:1788581252.954940:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184136960 00000100:00100000:2.0:1788581252.954965:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184136832:12345-0@lo:400:kworker.0 Request processed in 137us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.954972:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137472 00000100:00100000:2.0:1788581252.954973:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581252.954977:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137472 00000100:00100000:0.0:1788581252.955001:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581252.955021:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184136960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.955053:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184136960:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.955059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581252.955072:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581252.955077:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184137472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.955102:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184137472:12345-0@lo:400:kworker.0 Request processed in 25us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.955107:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788581252.955764:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581252.955768:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581252.955771:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581252.955786:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137344 00000100:00100000:0.0:1788581252.955792:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137344 00000100:00100000:0.0:1788581252.955849:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788581252.955856:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184137344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.955899:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184137344:12345-0@lo:400:kworker.0 Request processed in 45us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581252.955907:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788581252.955931:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581252.955949:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184136960:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.955962:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184137472:0@lo:400:kworker.0 00000100:00100000:0.0:1788581252.955972:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184136832:0@lo:400:kworker.0 00010000:00080000:0.0:1788581252.955982:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad4700 x1875463184137344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581252.955993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184137344:0@lo:400:kworker.0 00000100:00100000:3.0:1788581252.958645:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184136576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581253.353713:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581253.354187:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581253.354218:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170434944 00000100:00100000:2.0:1788581253.354229:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170434944 00000100:00100000:2.0:1788581253.354298:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:2.0:1788581253.354310:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170434944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581253.354368:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581253.354383:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170434944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 74us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581253.354391:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:3.0:1788581253.354968:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435200 00000100:00100000:3.0:1788581253.354975:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435200 00000100:00100000:3.0:1788581253.355027:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435072 00000100:00100000:3.0:1788581253.355031:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435072 00000100:00100000:3.0:1788581253.355053:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1788581253.355061:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170435200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:2.0:1788581253.355101:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581253.355106:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581253.355109:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170435200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581253.355117:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1788581253.355134:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:3.0:1788581253.355141:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170435072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581253.355178:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170435072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581253.355184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 112 00010000:00010000:0.0:1788581253.825889:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581253.956759:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184137728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581253.956831:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581253.957175:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137728 00000100:00100000:0.0:1788581253.957184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137728 00000100:00100000:0.0:1788581253.957321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581253.957331:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184137728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581253.957362:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581253.957416:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184137728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581253.957423:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581253.957478:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184137728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581254.855463:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581255.873483:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581256.001712:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184137984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581256.001782:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581256.001857:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581256.001864:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184137856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581256.001891:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581256.002025:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137984 00000100:00100000:0.0:1788581256.002033:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137984 00000100:00100000:0.0:1788581256.002088:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184137856 00000100:00100000:0.0:1788581256.002091:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184137856 00000100:00100000:0.0:1788581256.002110:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788581256.002126:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184137984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581256.002157:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581256.002202:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184137984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581256.002209:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788581256.002226:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581256.002232:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184137856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581256.002242:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581256.002302:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184137856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581256.002308:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788581256.002370:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad4a80 x1875463184137856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581256.002388:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184137856:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788581256.002400:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43817480 x1875463184137984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581256.002410:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184137984:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581256.002606:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581256.527076:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184138112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581256.527142:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581256.527211:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138112 00000100:00100000:2.0:1788581256.527219:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138112 00000100:00100000:2.0:1788581256.527272:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788581256.527281:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184138112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581256.527314:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788581256.527357:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184138112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581256.527363:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788581256.527406:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184138112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581256.898583:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581256.967879:0:11968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:07:35 (1788581255) === 00000100:00100000:2.0:1788581257.484332:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.484437:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435328 00000100:00100000:1.0:1788581257.484447:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435328 00000100:00100000:1.0:1788581257.484607:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 286 00000100:00100000:1.0:1788581257.484617:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:8709:x1875463170435328:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581257.484644:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581257.484660:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6ba00/0x50f0cc74b7b2fc58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21ef2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.484704:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6ba00/0x50f0cc74b7b2fc58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ef2 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.484715:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6ba00/0x50f0cc74b7b2fc58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ef2 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.484723:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ba00, rc 0) 00000100:00100000:1.0:1788581257.484787:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170435328:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 171us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.484794:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 286 00000100:00100000:1.0:1788581257.487518:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.493613:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435456 00000100:00100000:2.0:1788581257.493626:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435456 00000100:00100000:2.0:1788581257.493762:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:2.0:1788581257.493774:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170435456:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581257.493963:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170435456:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 191us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.493971:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:3.0:1788581257.509090:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.510131:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435584 00000100:00100000:2.0:1788581257.510143:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435584 00000100:00100000:2.0:1788581257.510207:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:2.0:1788581257.510216:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170435584:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788581257.510389:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170435584:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 173us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.510406:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:0.0:1788581257.524698:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.526097:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435712 00000100:00100000:2.0:1788581257.526112:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435712 00000100:00100000:2.0:1788581257.526185:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:2.0:1788581257.526197:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435712:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581257.526411:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435712:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 215us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.526419:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:3.0:1788581257.556517:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.558167:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435840 00000100:00100000:1.0:1788581257.558188:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435840 00000100:00100000:1.0:1788581257.558321:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:1.0:1788581257.558334:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435840:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581257.558781:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435840:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 447us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.558792:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:3.0:1788581257.562628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.562911:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170435968 00000100:00100000:2.0:1788581257.562925:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170435968 00000100:00100000:2.0:1788581257.562996:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:2.0:1788581257.563009:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435968:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581257.563224:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8713:x1875463170435968:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 217us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.563232:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:2.0:1788581257.575470:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581257.575601:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436096 00000100:00100000:0.0:1788581257.575615:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436096 00000100:00100000:0.0:1788581257.575697:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:0.0:1788581257.575709:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+11:8709:x1875463170436096:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581257.575733:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581257.575756:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e82160400/0x50f0cc74b7b2fc5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21f23 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581257.575809:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e82160400/0x50f0cc74b7b2fc5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f23 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581257.575824:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e82160400/0x50f0cc74b7b2fc5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f23 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581257.575836:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e82160400, rc 0) 00000100:00100000:0.0:1788581257.575924:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:8709:x1875463170436096:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 216us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581257.575931:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:3.0:1788581257.583092:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.583338:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436224 00000100:00100000:1.0:1788581257.583352:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436224 00000100:00100000:1.0:1788581257.583430:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:1.0:1788581257.583443:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:8709:x1875463170436224:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788581257.583482:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788581257.583524:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788581257.583529:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788581257.583532:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788581257.583535:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788581257.583538:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788581257.586232:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:8709:x1875463170436224:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 2776us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.586250:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:2.0:1788581257.591899:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.592101:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436352 00000100:00100000:1.0:1788581257.592114:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436352 00000100:00100000:1.0:1788581257.592188:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:1.0:1788581257.592199:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:8709:x1875463170436352:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581257.592222:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581257.592247:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21f2a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.592322:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.592333:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581257.592344:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6aa00, rc 0) 00000100:00100000:1.0:1788581257.592419:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8709:x1875463170436352:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 221us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.592427:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:3.0:1788581257.594745:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.594940:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436480 00000100:00100000:1.0:1788581257.594952:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436480 00000100:00100000:1.0:1788581257.595024:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:1.0:1788581257.595054:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8709:x1875463170436480:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788581257.595306:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8709:x1875463170436480:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 253us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.595314:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:3.0:1788581257.597587:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581257.597756:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436608 00000100:00100000:0.0:1788581257.597768:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436608 00000100:00100000:0.0:1788581257.597836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:0.0:1788581257.597848:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8709:x1875463170436608:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788581257.598048:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8709:x1875463170436608:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 201us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581257.598058:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:0.0:1788581257.602363:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.602541:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436736 00000100:00100000:2.0:1788581257.602565:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436736 00000100:00100000:2.0:1788581257.602626:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:2.0:1788581257.602639:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8717:x1875463170436736:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581257.602850:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8717:x1875463170436736:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 213us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.602859:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:3.0:1788581257.612483:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.612716:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436864 00000100:00100000:1.0:1788581257.612730:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436864 00000100:00100000:1.0:1788581257.612801:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:1.0:1788581257.612813:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8717:x1875463170436864:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581257.613034:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:8717:x1875463170436864:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 222us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.613044:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:3.0:1788581257.631245:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581257.631345:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581257.631372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581257.631407:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.633913:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170436992 00000100:00100000:2.0:1788581257.633934:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170436992 00000100:00100000:1.0:1788581257.634002:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437632 00000100:00100000:2.0:1788581257.634004:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437760 00000100:00100000:1.0:1788581257.634010:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437632 00000100:00100000:2.0:1788581257.634011:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437760 00000100:00100000:1.0:1788581257.634095:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437248 00000100:00100000:1.0:1788581257.634099:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437248 00000100:00100000:1.0:1788581257.634121:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1788581257.634134:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170437632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581257.634272:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170437632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 140us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.634291:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1788581257.634311:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581257.634316:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875463170436992:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581257.634344:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4d3903fb-7514-43fd-b94a-0d806aeb9639@192.168.203.3@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1788581257.634387:0:6494:0:(genops.c:1385:class_connect()) connect: client 4d3903fb-7514-43fd-b94a-0d806aeb9639, cookie 0x50f0cc74b7b2fc6d 00000004:00100000:1.0:1788581257.634418:0:6494:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581257.634587:0:6494:0:(import.c:65:import_set_state_nolock()) ffff995d422bf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581257.634635:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2392:x1875463170436992:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 317us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.634642:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581257.634904:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581257.634910:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875463170437248:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581257.634929:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 4d3903fb-7514-43fd-b94a-0d806aeb9639@192.168.203.3@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1788581257.634956:0:6494:0:(genops.c:1385:class_connect()) connect: client 4d3903fb-7514-43fd-b94a-0d806aeb9639, cookie 0x50f0cc74b7b2fc74 00000004:00100000:1.0:1788581257.634972:0:6494:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581257.635036:0:6494:0:(import.c:65:import_set_state_nolock()) ffff995d422b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581257.635063:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2392:x1875463170437248:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 152us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.635070:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00080000:1.0:1788581257.635132:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581257.635137:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581257.635749:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1788581257.635762:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170437760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581257.635825:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170437760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.635833:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1788581257.641689:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.641734:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.641765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581257.641844:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437504 00000100:00100000:1.0:1788581257.641857:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437504 00000100:00100000:1.0:1788581257.641934:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437376 00000100:00100000:1.0:1788581257.641938:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437376 00000100:00100000:1.0:1788581257.641955:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437120 00000100:00100000:1.0:1788581257.641957:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437120 00000100:00100000:1.0:1788581257.641973:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1788581257.641990:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+7:8709:x1875463170437504:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788581257.642043:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788581257.642195:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+7:8709:x1875463170437504:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 207us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.642203:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1788581257.642230:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1788581257.642237:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:0:x1875463170437376:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788581257.642278:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581257.642336:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1788581257.642349:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:0:x1875463170437120:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788581257.642366:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581257.642398:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:0:x1875463170437120:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 53us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581257.642405:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581257.642521:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:0:x1875463170437376:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 283us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581257.642529:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00080000:2.0:1788581257.642811:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581257.642815:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581257.644073:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581257.644472:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170437888 00000100:00100000:0.0:1788581257.644499:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170437888 00000100:00100000:0.0:1788581257.644618:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1788581257.644631:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170437888:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788581257.644873:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170437888:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 243us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581257.644882:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1788581257.649763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581257.650233:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438272 00000100:00100000:3.0:1788581257.650247:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438272 00000100:00100000:3.0:1788581257.650344:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581257.650356:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170438272:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788581257.650475:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170438272:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 121us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581257.650485:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1788581257.650646:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.650756:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438016 00000100:00100000:2.0:1788581257.650774:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438016 00000100:00100000:1.0:1788581257.650802:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581257.650823:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438144 00000100:00100000:2.0:1788581257.650828:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438144 00000100:00100000:1.0:1788581257.650837:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581257.650914:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875463170438016:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788581257.650950:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4d3903fb-7514-43fd-b94a-0d806aeb9639@192.168.203.3@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1788581257.650991:0:8408:0:(genops.c:1385:class_connect()) connect: client 4d3903fb-7514-43fd-b94a-0d806aeb9639, cookie 0x50f0cc74b7b2fc7b 00002000:00100000:1.0:1788581257.651006:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4d3903fb-7514-43fd-b94a-0d806aeb9639/ffff995e7faa5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788581257.651020:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788581257.651127:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788581257.651160:0:8408:0:(import.c:65:import_set_state_nolock()) ffff995e7faa6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581257.651211:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2392:x1875463170438016:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 365us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581257.653414:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581257.653525:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438400 00000100:00100000:3.0:1788581257.653538:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438400 00000100:00100000:3.0:1788581257.653606:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1788581257.653641:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170438400:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788581257.653765:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788581257.653861:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:8709:x1875463170438400:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 228us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581257.653869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1788581257.654788:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581257.654801:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170438144:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788581257.655468:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4d3903fb-7514-43fd-b94a-0d806aeb9639@192.168.203.3@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1788581257.655516:0:8410:0:(genops.c:1385:class_connect()) connect: client 4d3903fb-7514-43fd-b94a-0d806aeb9639, cookie 0x50f0cc74b7b2fc82 00002000:00100000:2.0:1788581257.655534:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4d3903fb-7514-43fd-b94a-0d806aeb9639/ffff995e6f941800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581257.655558:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581257.655737:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581257.656206:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e6f942800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581257.656641:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2392:x1875463170438144:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 1834us (5834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581257.657011:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1788581257.662240:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00010000:00010000:1.0:1788581257.922399:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581258.050558:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184138496:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.050639:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581258.050702:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184138240:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.050738:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184139008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581258.050854:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184138368:0@lo:400:kworker.0 00000100:00100000:0.0:1788581258.050906:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138496 00000100:00100000:0.0:1788581258.050916:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138496 00000100:00100000:0.0:1788581258.050977:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581258.050988:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.051458:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.051501:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.051527:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.051559:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184140032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581258.051585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.051634:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139008 00000100:00100000:3.0:1788581258.051641:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139008 00000100:00100000:3.0:1788581258.051706:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139520 00000100:00100000:3.0:1788581258.051709:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139520 00000100:00100000:3.0:1788581258.051734:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788581258.051743:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.051796:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184139008:12345-0@lo:400:kworker.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.051803:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788581258.051819:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788581258.051825:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.051854:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184139520:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.051872:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:3.0:1788581258.051907:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9c00 x1875463184139008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.051920:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184139008:0@lo:400:kworker.0 00010000:00080000:3.0:1788581258.051930:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faabb80 x1875463184139520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.051938:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.052003:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184138624:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.054236:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.054448:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184139136:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.054502:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.054536:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184139648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.054561:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.054611:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139136 00000100:00100000:3.0:1788581258.054617:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139136 00000100:00100000:3.0:1788581258.054678:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139648 00000100:00100000:3.0:1788581258.054682:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139648 00000100:00100000:3.0:1788581258.054707:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581258.054716:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.054768:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184139136:12345-0@lo:400:kworker.0 Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.054774:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581258.054788:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581258.054793:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184139648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.054834:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184139648:12345-0@lo:400:kworker.0 Request processed in 41us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.054840:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788581258.054873:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9880 x1875463184139136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.054886:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184139136:0@lo:400:kworker.0 00010000:00080000:3.0:1788581258.054895:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faab100 x1875463184139648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.054902:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184139648:0@lo:400:kworker.0 00000100:00080000:3.0:1788581258.054939:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581258.054943:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581258.054958:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581258.054975:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138624 00000100:00100000:3.0:1788581258.054979:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138624 00000100:00100000:3.0:1788581258.055004:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788581258.055010:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.055056:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184138624:12345-0@lo:400:kworker.0 Request processed in 46us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.055072:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788581258.055096:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184138624:0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.056577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581258.056688:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184138752:0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.056768:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581258.056806:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138752 00000100:00100000:2.0:1788581258.056815:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138752 00000100:00100000:3.0:1788581258.056818:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140032 00000100:00100000:3.0:1788581258.056833:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140032 00000100:00100000:2.0:1788581258.056891:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788581258.056901:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581258.056909:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184138752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.056920:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184140032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581258.056981:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581258.057070:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184140032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.057076:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788581258.057417:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad3800 x1875463184140032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.057438:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184140032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581258.057487:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057523:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.057547:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139264 00000100:00100000:3.0:1788581258.057551:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139264 00000100:00100000:3.0:1788581258.057582:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581258.057588:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184139264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057620:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184139264:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.057626:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788581258.057640:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581258.057658:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa8a80 x1875463184139264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.057680:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057687:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184139776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057709:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581258.057729:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139776 00000100:00100000:3.0:1788581258.057732:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139776 00000100:00100000:3.0:1788581258.057758:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581258.057764:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184139776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057805:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184139776:12345-0@lo:400:kworker.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.057811:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788581258.057825:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581258.057840:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa8380 x1875463184139776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581258.057849:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184139776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.057896:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138240 00000100:00100000:3.0:1788581258.057899:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138240 00000100:00100000:3.0:1788581258.057922:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788581258.057929:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184138240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581258.058698:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184138240:12345-0@lo:400:kworker.0 Request processed in 766us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.058707:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788581258.058767:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184138240:0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.058807:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184138752:12345-0@lo:400:kworker.0 Request processed in 1895us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581258.058815:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184138752:0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.058826:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581258.060939:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581258.061136:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184138880:0@lo:400:kworker.0 00000100:00100000:1.0:1788581258.061200:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581258.061488:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184139392:0@lo:400:kworker.0 00000100:00100000:1.0:1788581258.061679:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581258.061884:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138368 00000100:00100000:2.0:1788581258.061894:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138368 00000100:00100000:2.0:1788581258.061953:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184138880 00000100:00100000:2.0:1788581258.061956:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184138880 00000100:00100000:2.0:1788581258.061985:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139392 00000100:00100000:2.0:1788581258.061988:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139392 00000100:00100000:2.0:1788581258.062021:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581258.062032:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.062096:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184138368:12345-0@lo:400:kworker.0 Request processed in 66us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581258.062104:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581258.062122:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788581258.062128:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.062156:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184138880:12345-0@lo:400:kworker.0 Request processed in 28us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581258.062172:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788581258.062183:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788581258.062188:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.062214:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184139392:12345-0@lo:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581258.062220:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788581258.062236:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581258.063410:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184139392:0@lo:400:kworker.0 00000100:00100000:1.0:1788581258.063427:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184139904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581258.063485:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581258.063774:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184138368:0@lo:400:kworker.0 00000100:00100000:1.0:1788581258.063787:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184138880:0@lo:400:kworker.0 00000100:00100000:2.0:1788581258.063873:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184139904 00000100:00100000:2.0:1788581258.063880:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184139904 00000100:00100000:2.0:1788581258.063926:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581258.063936:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184139904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581258.064082:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581258.064246:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184139904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581258.064287:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581258.064311:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184138496:12345-0@lo:400:kworker.0 Request processed in 13322us (13669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581258.064322:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788581258.064376:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184138496:0@lo:400:kworker.0 00010000:00080000:1.0:1788581258.064458:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432bca80 x1875463184139904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581258.064478:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184139904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581258.945520:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581259.077431:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184140160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581259.077549:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581259.077611:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140160 00000100:00100000:1.0:1788581259.077622:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140160 00000100:00100000:1.0:1788581259.077705:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788581259.077716:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184140160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581259.077758:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581259.077823:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184140160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581259.077830:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581259.077886:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184140160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581259.969559:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581260.994418:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581261.121588:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184140288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581261.121702:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581261.121882:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581261.121895:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184140416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581261.121942:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581261.121980:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140288 00000100:00100000:3.0:1788581261.121990:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140288 00000100:00100000:3.0:1788581261.122051:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140416 00000100:00100000:3.0:1788581261.122055:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140416 00000100:00100000:3.0:1788581261.122077:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581261.122103:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184140288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581261.122142:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581261.122192:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184140288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581261.122199:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581261.122220:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788581261.122227:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184140416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581261.122237:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581261.122296:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184140416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581261.122302:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788581261.122340:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facf480 x1875463184140416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581261.122362:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184140416:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581261.124823:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581261.128407:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9180 x1875463184140288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581261.128444:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184140288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581261.633723:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581261.633753:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184140544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581261.633851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581261.634316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140544 00000100:00100000:0.0:1788581261.634328:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140544 00000100:00100000:0.0:1788581261.634393:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581261.634406:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184140544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581261.634469:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581261.634531:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184140544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581261.634540:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581261.635612:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184140544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581262.017706:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581263.044529:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581263.090377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581263.090429:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581263.090469:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581263.090500:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438528 00000100:00100000:2.0:1788581263.090516:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438528 00000100:00100000:3.0:1788581263.090520:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581263.090550:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438784 00000100:00100000:1.0:1788581263.090570:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438784 00000100:00100000:3.0:1788581263.090578:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581263.090596:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:2.0:1788581263.090612:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170438528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581263.090625:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581263.090681:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581263.090719:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170438528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581263.090721:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439296 00000100:00100000:3.0:1788581263.090730:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439296 00000100:00100000:2.0:1788581263.090737:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:3.0:1788581263.090792:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439168 00000100:00100000:3.0:1788581263.090797:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439168 00000100:00100000:3.0:1788581263.090832:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1788581263.090842:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581263.090918:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581263.090927:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1788581263.090945:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1788581263.090952:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439168:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581263.090978:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439168:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581263.090984:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:1.0:1788581263.092928:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439040 00000100:00100000:1.0:1788581263.092943:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439040 00000100:00100000:1.0:1788581263.093103:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438656 00000100:00100000:1.0:1788581263.093108:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438656 00000100:00100000:1.0:1788581263.093126:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170438912 00000100:00100000:1.0:1788581263.093129:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170438912 00000100:00100000:1.0:1788581263.093149:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1788581263.093158:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170438784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581263.093222:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170438784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 65us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.093229:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1788581263.093244:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1788581263.093250:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581263.093288:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170439040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.093295:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1788581263.093307:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1788581263.093312:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170438656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581263.093334:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170438656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.093340:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1788581263.093350:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1788581263.093356:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170438912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581263.093377:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170438912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.093397:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00080000:1.0:1788581263.095383:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581263.095391:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581263.095394:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581263.095397:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581263.170843:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581263.170866:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184140672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581263.170927:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581263.171183:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140672 00000100:00100000:3.0:1788581263.171191:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140672 00000100:00100000:3.0:1788581263.171246:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788581263.171270:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184140672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581263.171299:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581263.171345:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184140672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581263.171351:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788581263.171382:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581263.171406:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad3800 x1875463184140672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581263.171422:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184140672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581263.172222:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184140928:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172335:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184141440:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172362:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172381:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184141952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172407:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172437:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788581263.172443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184141056:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172482:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184141568:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172518:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172540:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.172567:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141440 00000100:00100000:1.0:1788581263.172573:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141440 00000100:00100000:1.0:1788581263.172606:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581263.172614:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184141440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.172680:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184141440:12345-0@lo:400:kworker.0 Request processed in 66us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.172687:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581263.172710:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141056 00000100:00100000:1.0:1788581263.172714:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141056 00000100:00100000:2.0:1788581263.172734:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141952 00000100:00100000:1.0:1788581263.172739:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141568 00000100:00100000:2.0:1788581263.172741:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141952 00000100:00100000:1.0:1788581263.172745:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141568 00000100:00100000:3.0:1788581263.172977:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184141184:0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.173093:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184140800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581263.173240:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581263.173284:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184141312:0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.173306:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581263.173322:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184141824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.173342:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581263.173360:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184142336:0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.173378:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581263.173409:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140800 00000100:00100000:0.0:1788581263.173413:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140800 00000100:00100000:3.0:1788581263.173465:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581263.173488:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184141696:0@lo:400:kworker.0 00000100:00100000:3.0:1788581263.173509:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581263.173531:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184142208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581263.173553:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581263.173858:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142080 00000100:00100000:3.0:1788581263.173936:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184140928 00000100:00100000:3.0:1788581263.173941:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184140928 00000100:00100000:3.0:1788581263.173970:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788581263.173977:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184140928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174232:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142080 00000100:00100000:1.0:1788581263.174268:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141312 00000100:00100000:1.0:1788581263.174273:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141312 00000100:00100000:1.0:1788581263.174285:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141696 00000100:00100000:1.0:1788581263.174288:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141696 00000100:00100000:1.0:1788581263.174302:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142208 00000100:00100000:1.0:1788581263.174305:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142208 00000100:00100000:1.0:1788581263.174319:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788581263.174326:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184141056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174369:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184141056:12345-0@lo:400:kworker.0 Request processed in 44us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174375:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788581263.174389:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788581263.174395:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184141568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174421:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184141568:12345-0@lo:400:kworker.0 Request processed in 27us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174426:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788581263.174436:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788581263.174442:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184142080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174467:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184142080:12345-0@lo:400:kworker.0 Request processed in 25us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174480:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788581263.174490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788581263.174495:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184141312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174527:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184141312:12345-0@lo:400:kworker.0 Request processed in 32us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174532:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788581263.174542:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788581263.174548:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184141696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174575:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184141696:12345-0@lo:400:kworker.0 Request processed in 27us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788581263.174604:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788581263.174611:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174647:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184142208:12345-0@lo:400:kworker.0 Request processed in 37us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174652:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788581263.174679:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141184 00000100:00100000:1.0:1788581263.174683:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141184 00000100:00100000:1.0:1788581263.174705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788581263.174710:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184141184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174740:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184141184:12345-0@lo:400:kworker.0 Request processed in 30us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581263.174746:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788581263.174783:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184141184:0@lo:400:kworker.0 00010000:00080000:1.0:1788581263.174807:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4a80 x1875463184141696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581263.174817:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184141696:0@lo:400:kworker.0 00010000:00080000:1.0:1788581263.174827:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ef480 x1875463184142208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581263.174834:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184142208:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174887:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184141056:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174898:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184141568:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174906:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174917:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184141440:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.174960:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184141824 00000100:00100000:1.0:1788581263.174964:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184141824 00000100:00100000:2.0:1788581263.174992:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142336 00000100:00100000:2.0:1788581263.174998:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142336 00000100:00100000:3.0:1788581263.175227:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184140928:12345-0@lo:400:kworker.0 Request processed in 1249us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581263.175234:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788581263.175279:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581263.175283:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581263.175285:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581263.175286:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581263.176185:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788581263.176199:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875463184140800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581263.176219:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581263.176222:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581263.176234:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184141952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.176287:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875463184140800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581263.176294:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581263.176315:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184141952:12345-0@lo:400:kworker.0 Request processed in 83us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581263.176319:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581263.176328:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581263.176332:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184141824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581263.176350:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788581263.176360:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184142336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581263.176370:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184141824:12345-0@lo:400:kworker.0 Request processed in 42us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581263.176386:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581263.176404:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184142336:12345-0@lo:400:kworker.0 Request processed in 44us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581263.176412:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788581263.176435:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d431df480 x1875463184140800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581263.176453:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184140800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581263.176465:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184141312:0@lo:400:kworker.0 00010000:00080000:0.0:1788581263.176476:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a5180 x1875463184141824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581263.176483:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184141824:0@lo:400:kworker.0 00010000:00080000:0.0:1788581263.176491:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ed500 x1875463184142336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581263.176498:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184142336:0@lo:400:kworker.0 00010000:00080000:1.0:1788581263.177216:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432a4e00 x1875463184141952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581263.177228:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184141952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581263.177240:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184140928:0@lo:400:kworker.0 00000001:02000400:3.0:1788581263.290933:0:12161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1788581263.683563:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00100000:0.0:1788581263.684693:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00100000:1.0:1788581263.687415:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00100000:2.0:1788581263.690110:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00010000:00010000:0.0:1788581264.065401:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581264.193795:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184142464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581264.193863:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581264.193970:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142464 00000100:00100000:1.0:1788581264.193978:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142464 00000100:00100000:1.0:1788581264.194028:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581264.194039:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184142464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581264.194082:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581264.194144:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184142464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581264.194151:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581264.194191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184142464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581265.089520:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581266.120838:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581266.242496:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184142592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581266.242562:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581266.242682:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142592 00000100:00100000:3.0:1788581266.242689:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142592 00000100:00100000:3.0:1788581266.242747:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788581266.242757:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184142592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581266.242785:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581266.242834:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184142592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581266.242841:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788581266.242878:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814a80 x1875463184142592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581266.242895:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184142592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581266.242958:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581266.243318:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184142720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581266.243364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581266.243454:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142720 00000100:00100000:2.0:1788581266.243459:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142720 00000100:00100000:2.0:1788581266.243497:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581266.243504:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184142720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581266.243523:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581266.243555:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184142720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581266.243562:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788581266.243719:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581266.243740:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ef100 x1875463184142720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581266.243752:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184142720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581266.754589:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581266.754627:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184142848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581266.754694:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581266.754756:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142848 00000100:00100000:3.0:1788581266.754764:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142848 00000100:00100000:3.0:1788581266.754810:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788581266.754819:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184142848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581266.754850:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581266.755943:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184142848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1120us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581266.755953:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788581266.756128:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184142848:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581267.138633:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581268.161435:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581268.204378:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204451:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204484:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204506:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204526:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204578:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581268.204616:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440192 00000100:00100000:0.0:1788581268.204626:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440192 00000100:00100000:0.0:1788581268.204706:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440064 00000100:00100000:0.0:1788581268.204710:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440064 00000100:00100000:0.0:1788581268.204734:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1788581268.204745:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170440192:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.204821:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170440192:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.204830:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1788581268.204846:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1788581268.204852:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170440064:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.204876:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170440064:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.204882:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1788581268.204918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439680 00000100:00100000:0.0:1788581268.204922:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439680 00000100:00100000:0.0:1788581268.204947:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439936 00000100:00100000:0.0:1788581268.204949:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439936 00000100:00100000:0.0:1788581268.204959:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439552 00000100:00100000:0.0:1788581268.204961:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439552 00000100:00100000:0.0:1788581268.204972:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439808 00000100:00100000:0.0:1788581268.204975:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439808 00000100:00100000:0.0:1788581268.204987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1788581268.204993:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170439680:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.205022:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170439680:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.205028:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1788581268.205039:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1788581268.205045:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170439936:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.205072:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170439936:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.205078:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1788581268.205088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1788581268.205093:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170439552:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.205109:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170439552:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 17us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.205115:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1788581268.205123:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:0.0:1788581268.205128:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170439808:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581268.205143:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170439808:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 15us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.205148:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00080000:0.0:1788581268.205199:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581268.205203:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581268.205205:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581268.205207:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581268.205342:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170439424 00000100:00100000:2.0:1788581268.205346:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170439424 00000100:00100000:2.0:1788581268.205377:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 302 00000100:00100000:2.0:1788581268.205383:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170439424:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581268.205406:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170439424:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581268.205412:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 302 00000100:00100000:3.0:1788581268.289435:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581268.289458:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184142976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581268.289540:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.289678:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184142976 00000100:00100000:3.0:1788581268.289685:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184142976 00000100:00100000:3.0:1788581268.289743:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581268.289752:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184142976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581268.289779:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581268.289824:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184142976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581268.289842:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788581268.289865:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581268.289893:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814000 x1875463184142976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581268.289911:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184142976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581268.290081:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581268.290091:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184143104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581268.290121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581268.290149:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143104 00000100:00100000:1.0:1788581268.290153:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143104 00000100:00100000:1.0:1788581268.290182:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788581268.290188:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184143104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788581268.290198:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581268.290228:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184143104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581268.290233:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788581268.290247:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788581268.290283:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d431dea00 x1875463184143104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581268.290295:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184143104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581268.298301:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.298380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581268.298544:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143232 00000100:00100000:2.0:1788581268.298554:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143232 00000100:00100000:2.0:1788581268.298615:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788581268.298624:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184143232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581268.298909:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184143360:0@lo:400:kworker.0 00000100:00100000:1.0:1788581268.298946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581268.305465:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184143232:12345-0@lo:400:kworker.0 Request processed in 6833us (7076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581268.305481:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788581268.306194:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.306233:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143360 00000100:00100000:0.0:1788581268.306240:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143360 00000100:00100000:0.0:1788581268.306464:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788581268.306474:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.306627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184143360:12345-0@lo:400:kworker.0 Request processed in 153us (7679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.306634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581268.306745:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.306787:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.306826:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143488 00000100:00100000:3.0:1788581268.306831:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143488 00000100:00100000:3.0:1788581268.306859:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788581268.306865:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184143488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.306904:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184143488:12345-0@lo:400:kworker.0 Request processed in 39us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581268.306910:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788581268.307219:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.307251:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184143616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.307302:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581268.309895:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184143360:0@lo:400:kworker.0 00000100:00100000:2.0:1788581268.314390:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581268.314411:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184143744:0@lo:400:kworker.0 00000100:00100000:2.0:1788581268.314476:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581268.314529:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184143872:0@lo:400:kworker.0 00000100:00100000:2.0:1788581268.314571:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.315452:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.315485:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.315509:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581268.315515:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.315538:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581268.317776:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143616 00000100:00100000:1.0:1788581268.317790:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143616 00000100:00100000:1.0:1788581268.317841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143744 00000100:00100000:1.0:1788581268.317845:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143744 00000100:00100000:1.0:1788581268.317903:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581268.317932:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184143744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581268.318035:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184143744:12345-0@lo:400:kworker.0 Request processed in 106us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581268.318044:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788581268.318964:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144256 00000100:00100000:0.0:1788581268.318972:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144256 00000100:00100000:0.0:1788581268.319035:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581268.319043:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.319096:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184144256:12345-0@lo:400:kworker.0 Request processed in 54us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.319102:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788581268.319470:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ed500 x1875463184144256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581268.319502:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.319578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.319627:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184144512:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.319662:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.319678:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581268.319684:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581268.319708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.319732:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581268.319755:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184143744:0@lo:400:kworker.0 00000100:00080000:1.0:1788581268.319947:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581268.320016:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144384 00000100:00100000:0.0:1788581268.320022:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144384 00000100:00100000:0.0:1788581268.320059:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144000 00000100:00100000:0.0:1788581268.320062:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144000 00000100:00100000:0.0:1788581268.320071:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144512 00000100:00100000:0.0:1788581268.320073:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144512 00000100:00100000:0.0:1788581268.320084:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184143872 00000100:00100000:0.0:1788581268.320086:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184143872 00000100:00100000:0.0:1788581268.320099:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788581268.320106:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184144384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.320147:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184144384:12345-0@lo:400:kworker.0 Request processed in 42us (4608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.320154:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788581268.320166:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788581268.320172:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184144000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.320201:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184144000:12345-0@lo:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.320216:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788581268.320227:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788581268.320232:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184144512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.320276:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184144512:12345-0@lo:400:kworker.0 Request processed in 44us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.320281:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788581268.320290:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788581268.320295:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.320323:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184143872:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.320328:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788581268.320345:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144128 00000100:00100000:0.0:1788581268.320348:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144128 00000100:00100000:0.0:1788581268.320371:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581268.320376:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581268.320401:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184144128:12345-0@lo:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581268.320405:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581268.320430:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184143872:0@lo:400:kworker.0 00000100:00080000:1.0:1788581268.320546:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581268.320550:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581268.320552:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581268.321083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184144384:0@lo:400:kworker.0 00010000:00080000:3.0:1788581268.321111:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ef100 x1875463184144128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581268.321122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184144128:0@lo:400:kworker.0 00010000:00080000:3.0:1788581268.321131:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363480 x1875463184144512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581268.321139:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184144512:0@lo:400:kworker.0 00010000:00080000:3.0:1788581268.321149:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432edc00 x1875463184144000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581268.321156:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184144000:0@lo:400:kworker.0 00000100:00100000:2.0:1788581268.321895:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788581268.321904:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184143616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581268.321973:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184143616:12345-0@lo:400:kworker.0 Request processed in 70us (14670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581268.321980:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788581268.322534:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184143616:0@lo:400:kworker.0 00010000:00010000:1.0:1788581269.185497:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581269.314530:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581269.314553:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184144640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581269.314641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581269.315366:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144640 00000100:00100000:2.0:1788581269.315376:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144640 00000100:00100000:2.0:1788581269.315433:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581269.315443:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184144640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581269.315487:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581269.315828:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184144640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 385us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581269.315835:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788581269.315946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184144640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581270.213605:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788581270.294721:0:12476:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581270.294998:0:12476:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581271.234378:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581271.363587:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581271.363612:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184144768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581271.363689:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581271.363850:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144768 00000100:00100000:3.0:1788581271.363866:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144768 00000100:00100000:3.0:1788581271.363930:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581271.363942:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184144768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581271.363971:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581271.364223:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184144768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 283us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581271.364231:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788581271.364346:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d431dca80 x1875463184144768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581271.364365:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184144768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581271.364430:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581271.364541:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581271.364651:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581271.364768:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184144896 00000100:00100000:1.0:1788581271.364773:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184144896 00000100:00100000:1.0:1788581271.364873:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581271.364882:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184144896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581271.364897:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581271.364932:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184144896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581271.364939:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788581271.364966:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581271.364998:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43362300 x1875463184144896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581271.365019:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581271.874287:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184145024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581271.874379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581271.874553:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145024 00000100:00100000:1.0:1788581271.874562:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145024 00000100:00100000:1.0:1788581271.874619:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788581271.874630:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184145024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581271.874664:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788581271.874909:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184145024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 281us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581271.874937:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581271.875356:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184145024:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788581272.229375:0:12573:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581272.229926:0:12573:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581272.258627:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581273.281518:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581273.319788:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581273.319879:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581273.319916:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581273.319945:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440576 00000100:00100000:1.0:1788581273.319948:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581273.319955:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440576 00000100:00100000:1.0:1788581273.319964:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581273.319982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581273.320006:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440832 00000100:00100000:2.0:1788581273.320010:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440832 00000100:00100000:1.0:1788581273.320018:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581273.320022:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440448 00000100:00100000:2.0:1788581273.320025:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440448 00000100:00100000:2.0:1788581273.320036:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440704 00000100:00100000:2.0:1788581273.320038:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440704 00000100:00100000:1.0:1788581273.320041:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1788581273.320050:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1788581273.320051:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170440576:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581273.320055:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440832:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581273.320112:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440832:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581273.320120:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:0.0:1788581273.320189:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440320 00000100:00100000:0.0:1788581273.320194:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440320 00000100:00100000:0.0:1788581273.320225:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 304 00000100:00100000:0.0:1788581273.320232:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170440320:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581273.320316:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170440576:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 265us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581273.323366:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170440320:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 3124us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581273.323427:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 304 00000100:00100000:0.0:1788581273.323486:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441088 00000100:00100000:0.0:1788581273.323494:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441088 00000100:00100000:0.0:1788581273.323535:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170440960 00000100:00100000:0.0:1788581273.323538:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170440960 00000100:00100000:0.0:1788581273.323559:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1788581273.323579:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170441088:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581273.323621:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170441088:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581273.323627:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1788581273.323638:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581273.323644:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440960:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581273.323665:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440960:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (3646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581273.323684:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1788581273.323749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1788581273.323760:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170440448:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581273.323792:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170440448:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (3826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.323799:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1788581273.323814:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:3.0:1788581273.323821:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440704:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581273.323846:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170440704:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.323859:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00080000:3.0:1788581273.323876:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581273.323880:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581273.323882:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581273.323885:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581273.327079:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:0.0:1788581273.410679:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581273.410702:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184145152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581273.410816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.410908:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145152 00000100:00100000:3.0:1788581273.410916:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145152 00000100:00100000:3.0:1788581273.410989:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788581273.411005:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184145152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581273.411034:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581273.411081:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184145152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.411088:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788581273.411128:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa8a80 x1875463184145152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.411145:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184145152:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788581273.411283:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581273.412245:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184145408:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412309:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412336:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184145920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412378:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412398:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412419:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788581273.412424:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184145280:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412450:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412483:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184145792:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412525:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184146304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412549:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.412591:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145280 00000100:00100000:3.0:1788581273.412597:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145280 00000100:00100000:3.0:1788581273.412631:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788581273.412638:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412679:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184145280:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.412685:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788581273.412715:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145792 00000100:00100000:3.0:1788581273.412719:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145792 00000100:00100000:3.0:1788581273.412749:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581273.412756:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184145792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412788:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184145792:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.412794:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581273.412811:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146304 00000100:00100000:3.0:1788581273.412815:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146304 00000100:00100000:3.0:1788581273.412846:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581273.412853:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184146304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.412882:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184146304:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.412887:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581273.412908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145408 00000100:00100000:3.0:1788581273.412911:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145408 00000100:00100000:3.0:1788581273.412940:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145920 00000100:00100000:3.0:1788581273.412943:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145920 00000100:00100000:3.0:1788581273.412961:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146432 00000100:00100000:3.0:1788581273.412964:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146432 00000100:00100000:3.0:1788581273.412991:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581273.413382:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184145408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413418:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184145408:12345-0@lo:400:kworker.0 Request processed in 41us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.413424:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581273.413439:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788581273.413445:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184145920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413471:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184145920:12345-0@lo:400:kworker.0 Request processed in 27us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.413477:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788581273.413487:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788581273.413492:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184146432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413518:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184146432:12345-0@lo:400:kworker.0 Request processed in 26us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.413523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788581273.413548:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184145664:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413604:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184146176:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413626:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413642:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184146688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413660:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413679:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788581273.413693:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184145536:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413719:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413736:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184146048:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413756:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413770:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184146560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413787:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.413807:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145536 00000100:00100000:3.0:1788581273.413811:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145536 00000100:00100000:3.0:1788581273.413837:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581273.413842:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184145536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413877:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184145536:12345-0@lo:400:kworker.0 Request processed in 35us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.413883:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581273.413903:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184145664 00000100:00100000:3.0:1788581273.413907:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184145664 00000100:00100000:3.0:1788581273.413921:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146048 00000100:00100000:3.0:1788581273.413924:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146048 00000100:00100000:3.0:1788581273.413934:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146560 00000100:00100000:3.0:1788581273.413936:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146560 00000100:00100000:3.0:1788581273.413946:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581273.413952:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184145664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.413992:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184145664:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.414060:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581273.414074:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581273.414080:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184146048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414113:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184146048:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.414125:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581273.414136:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788581273.414141:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184146560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414169:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184146560:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.414175:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788581273.414191:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146176 00000100:00100000:3.0:1788581273.414195:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146176 00000100:00100000:3.0:1788581273.414215:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146688 00000100:00100000:3.0:1788581273.414217:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146688 00000100:00100000:3.0:1788581273.414231:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788581273.414237:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184146176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414284:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184146176:12345-0@lo:400:kworker.0 Request processed in 47us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.414290:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788581273.414302:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788581273.414308:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184146688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414333:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184146688:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.414339:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788581273.414360:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581273.414364:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581273.414366:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581273.414368:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581273.414405:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184145536:0@lo:400:kworker.0 00010000:00080000:3.0:1788581273.414417:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395880 x1875463184146048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.414433:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184146048:0@lo:400:kworker.0 00010000:00080000:3.0:1788581273.414443:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432edc00 x1875463184146560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.414451:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184146560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414460:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184145664:0@lo:400:kworker.0 00010000:00080000:3.0:1788581273.414469:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43394a80 x1875463184146176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.414475:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184146176:0@lo:400:kworker.0 00010000:00080000:3.0:1788581273.414483:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ef100 x1875463184146688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.414490:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184146688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414536:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184145280:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414546:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184145792:0@lo:400:kworker.0 00010000:00080000:3.0:1788581273.414557:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395500 x1875463184146304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581273.414578:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184146304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414588:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184145408:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414597:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184145920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581273.414605:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184146432:0@lo:400:kworker.0 00000100:00100000:1.0:1788581273.415129:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581273.415212:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184146816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581273.415478:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581273.415630:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146816 00000100:00100000:3.0:1788581273.415636:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146816 00000100:00100000:3.0:1788581273.415709:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581273.415717:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184146816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581273.415735:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581273.415781:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184146816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581273.415788:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788581273.415846:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9880 x1875463184146816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581273.415861:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184146816:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788581274.058760:0:12671:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581274.059602:0:12671:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788581274.308511:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581274.433497:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581274.433527:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184146944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581274.433632:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581274.433760:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184146944 00000100:00100000:1.0:1788581274.433771:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184146944 00000100:00100000:1.0:1788581274.433839:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788581274.433851:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184146944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581274.433895:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581274.434162:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184146944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 303us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581274.434176:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581274.434371:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184146944:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581275.329574:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788581275.971772:0:12768:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581275.972138:0:12768:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581276.354432:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581276.481445:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184147072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581276.481523:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581276.481682:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147072 00000100:00100000:3.0:1788581276.481690:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147072 00000100:00100000:3.0:1788581276.481756:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581276.481778:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184147072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581276.481878:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788581276.481938:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581276.481939:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184147072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581276.481949:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788581276.482102:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4a80 x1875463184147072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581276.482121:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184147072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581276.482318:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581276.482329:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184147200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581276.482359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581276.482444:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147200 00000100:00100000:3.0:1788581276.482449:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147200 00000100:00100000:3.0:1788581276.482494:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788581276.482495:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581276.482510:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184147200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581276.482522:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581276.482572:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184147200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581276.482578:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788581276.482757:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43360700 x1875463184147200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581276.482771:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184147200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581276.993558:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581276.993731:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184147328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581276.993804:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581276.993885:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147328 00000100:00100000:0.0:1788581276.993893:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147328 00000100:00100000:0.0:1788581276.993937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581276.993947:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184147328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581276.993986:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581276.994043:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184147328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581276.994050:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788581276.994077:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184147328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788581277.378362:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581277.624654:0:12866:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581277.624846:0:12866:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581278.402840:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581278.440378:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581278.440526:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441216 00000100:00100000:3.0:1788581278.440557:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441216 00000100:00100000:3.0:1788581278.440648:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 306 00000100:00100000:3.0:1788581278.440659:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170441216:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581278.440734:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170441216:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581278.440741:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 306 00000100:00100000:3.0:1788581278.445326:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581278.445500:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441344 00000100:00100000:0.0:1788581278.445594:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441344 00000100:00100000:0.0:1788581278.445722:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:0.0:1788581278.445736:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170441344:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:1.0:1788581278.446698:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581278.447980:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170441344:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2227us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.447998:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1788581278.449580:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581278.449695:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581278.449738:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581278.449764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581278.449785:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581278.449819:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441600 00000100:00100000:1.0:1788581278.449831:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441600 00000100:00100000:1.0:1788581278.449901:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441472 00000100:00100000:1.0:1788581278.449904:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441472 00000100:00100000:1.0:1788581278.449925:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441728 00000100:00100000:1.0:1788581278.449928:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441728 00000100:00100000:1.0:1788581278.449945:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1788581278.449957:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170441600:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581278.450070:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170441600:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581278.450078:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1788581278.450097:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:1.0:1788581278.450104:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170441472:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581278.450131:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170441472:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581278.450137:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:1.0:1788581278.450163:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:1.0:1788581278.450170:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170441728:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581278.450197:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170441728:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581278.450204:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:3.0:1788581278.450452:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441856 00000100:00100000:3.0:1788581278.450457:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441856 00000100:00100000:3.0:1788581278.450495:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170441984 00000100:00100000:3.0:1788581278.450498:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170441984 00000100:00100000:3.0:1788581278.450540:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1788581278.450549:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2392:x1875463170441856:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581278.450573:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fc7b 00000100:00080000:3.0:1788581278.450585:0:8906:0:(import.c:65:import_set_state_nolock()) ffff995e7faa6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581278.450644:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788581278.450820:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+2:2392:x1875463170441856:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 271us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581278.450830:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1788581278.450847:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1788581278.450859:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2392:x1875463170441984:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581278.450876:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fc82 00000100:00080000:3.0:1788581278.450887:0:8906:0:(import.c:65:import_set_state_nolock()) ffff995e6f942800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581278.450921:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788581278.450994:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581278.451045:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+2:2392:x1875463170441984:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 186us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581278.451069:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00010000:00010000:3.0:1788581278.451108:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581278.451585:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581278.451591:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581278.451595:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581278.451599:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581278.531970:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184147456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581278.532038:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.532101:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184147584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581278.532121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.532150:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147456 00000100:00100000:0.0:1788581278.532156:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147456 00000100:00100000:0.0:1788581278.532199:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147584 00000100:00100000:0.0:1788581278.532202:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147584 00000100:00100000:0.0:1788581278.532216:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581278.532223:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184147456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581278.532248:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581278.532300:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184147456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.532307:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581278.532321:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581278.532327:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184147584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581278.532335:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581278.532355:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184147584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.532360:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788581278.532375:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581278.532413:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9880 x1875463184147584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581278.532432:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184147584:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788581278.532454:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9c00 x1875463184147456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581278.532463:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184147456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581278.539600:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184147712:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.539688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.539737:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184148224:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.539765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.539787:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184148736:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.539810:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.539838:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788581278.539844:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184148096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.539869:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.539887:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184148608:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.539907:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.539938:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148224 00000100:00100000:0.0:1788581278.539945:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148224 00000100:00100000:0.0:1788581278.539988:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581278.539996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184148224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.540055:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184148224:12345-0@lo:400:kworker.0 Request processed in 60us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.540062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581278.540094:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148736 00000100:00100000:0.0:1788581278.540098:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148736 00000100:00100000:0.0:1788581278.540130:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148608 00000100:00100000:0.0:1788581278.540133:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148608 00000100:00100000:0.0:1788581278.540152:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581278.540158:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581278.540205:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184148224:0@lo:400:kworker.0 00000100:00100000:3.0:1788581278.540221:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147712 00000100:00100000:3.0:1788581278.540227:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147712 00000100:00100000:3.0:1788581278.540282:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788581278.540289:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184147712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.540812:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184148736:12345-0@lo:400:kworker.0 Request processed in 652us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.540819:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581278.540835:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788581278.540844:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184148608:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788581278.540859:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432edc00 x1875463184148736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581278.540873:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184148736:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.540879:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184148608:12345-0@lo:400:kworker.0 Request processed in 36us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.540885:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788581278.540903:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ef100 x1875463184148608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581278.540909:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148096 00000100:00100000:1.0:1788581278.540913:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184148608:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.540916:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148096 00000100:00100000:0.0:1788581278.540948:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788581278.540956:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184148096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541000:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184148096:12345-0@lo:400:kworker.0 Request processed in 46us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541005:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788581278.541043:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184147840:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541069:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.541091:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184148352:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541112:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.541131:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184148864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581278.541149:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184148096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541166:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581278.541195:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147840 00000100:00100000:0.0:1788581278.541195:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788581278.541201:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147840 00000100:00100000:0.0:1788581278.541206:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184147968:0@lo:400:kworker.0 00000100:00100000:1.0:1788581278.541235:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148352 00000100:00100000:1.0:1788581278.541239:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148352 00000100:00100000:0.0:1788581278.541247:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.541290:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184148480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541311:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.541327:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184148992:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541346:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.541365:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148864 00000100:00100000:0.0:1788581278.541369:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148864 00000100:00100000:0.0:1788581278.541385:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148480 00000100:00100000:0.0:1788581278.541388:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148480 00000100:00100000:0.0:1788581278.541399:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184148992 00000100:00100000:0.0:1788581278.541401:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184148992 00000100:00100000:0.0:1788581278.541411:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788581278.541416:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184147840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541449:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184147840:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788581278.541467:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788581278.541473:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541500:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184148864:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541506:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788581278.541516:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788581278.541522:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541569:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184148480:12345-0@lo:400:kworker.0 Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541575:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788581278.541587:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788581278.541592:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184148992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.541619:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184148992:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541625:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788581278.541645:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184147968 00000100:00100000:0.0:1788581278.541648:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184147968 00000100:00100000:0.0:1788581278.541669:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581278.541675:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184147968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581278.541800:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184147712:12345-0@lo:400:kworker.0 Request processed in 1511us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581278.541808:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788581278.541885:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184147968:12345-0@lo:400:kworker.0 Request processed in 210us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.541892:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788581278.541912:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581278.541916:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581278.541918:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581278.541949:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184147968:0@lo:400:kworker.0 00010000:00080000:0.0:1788581278.541960:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4a80 x1875463184148480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581278.541970:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184148480:0@lo:400:kworker.0 00010000:00080000:0.0:1788581278.541979:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395c00 x1875463184148992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581278.541986:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184148992:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.542005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184147840:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.542013:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184148864:0@lo:400:kworker.0 00000100:00100000:0.0:1788581278.542058:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184147712:0@lo:400:kworker.0 00000100:00100000:1.0:1788581278.542529:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581278.542551:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581278.542608:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184148352:12345-0@lo:400:kworker.0 Request processed in 60us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581278.542615:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581278.542647:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184148352:0@lo:400:kworker.0 00010000:00010000:1.0:1788581279.425521:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581279.553514:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581279.553553:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184149120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581279.553648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581279.553728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149120 00000100:00100000:1.0:1788581279.553737:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149120 00000100:00100000:1.0:1788581279.553796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581279.553807:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184149120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581279.553852:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581279.553904:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184149120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581279.553912:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581279.553979:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184149120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581280.453134:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581281.088677:0:13010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788581281.473474:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581281.602829:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581281.602862:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184149248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581281.602962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581281.603058:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149248 00000100:00100000:3.0:1788581281.603067:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149248 00000100:00100000:3.0:1788581281.603137:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788581281.603149:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184149248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581281.603189:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581281.603242:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184149248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581281.603250:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788581281.603880:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581281.604103:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581281.604121:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184149376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581281.604170:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581281.604325:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149376 00000100:00100000:2.0:1788581281.604332:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149376 00000100:00100000:2.0:1788581281.604391:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581281.604400:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184149376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581281.604418:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581281.604464:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184149376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581281.604470:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788581281.604507:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363100 x1875463184149376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581281.604541:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184149376:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788581281.604712:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581281.605030:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395f80 x1875463184149248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581281.605048:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184149248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581282.113856:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581282.113888:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184149504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581282.114006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.114093:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149504 00000100:00100000:1.0:1788581282.114102:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149504 00000100:00100000:1.0:1788581282.114161:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581282.114174:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184149504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581282.114217:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788581282.114294:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184149504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.114301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581282.114353:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184149504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581282.503923:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581283.521489:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581283.560753:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581283.560840:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581283.560872:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581283.560906:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581283.560947:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581283.560977:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442368 00000100:00100000:2.0:1788581283.560986:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442368 00000100:00100000:2.0:1788581283.561035:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442624 00000100:00100000:2.0:1788581283.561037:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442624 00000100:00100000:2.0:1788581283.561050:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442240 00000100:00100000:2.0:1788581283.561052:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442240 00000100:00100000:2.0:1788581283.561063:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442496 00000100:00100000:2.0:1788581283.561065:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442496 00000100:00100000:2.0:1788581283.561080:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:2.0:1788581283.561089:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170442368:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581283.561154:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170442368:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.561162:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:2.0:1788581283.561178:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:2.0:1788581283.561185:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170442624:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581283.561209:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170442624:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.561215:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:2.0:1788581283.561240:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:2.0:1788581283.561246:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170442240:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581283.561308:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170442240:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.561314:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:2.0:1788581283.561325:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:2.0:1788581283.561331:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170442496:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581283.561362:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170442496:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.561368:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00080000:2.0:1788581283.561385:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581283.561388:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581283.566219:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442112 00000100:00100000:3.0:1788581283.566247:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442112 00000100:00100000:3.0:1788581283.566329:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:3.0:1788581283.566339:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170442112:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581283.566428:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170442112:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 90us (5685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.566436:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:3.0:1788581283.650919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184149632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581283.651044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.651070:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184149888:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651111:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184150144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.651119:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651316:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651337:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651361:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651378:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651398:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651420:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788581283.651426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184149760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581283.651448:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651466:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184150272:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651488:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651518:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651545:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651569:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184151296:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.651588:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581283.651731:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149632 00000100:00100000:3.0:1788581283.651745:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149632 00000100:00100000:3.0:1788581283.651800:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149760 00000100:00100000:3.0:1788581283.651804:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149760 00000100:00100000:3.0:1788581283.651828:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581283.651837:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184149632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581283.651868:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581283.651920:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184149632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.651927:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581283.651944:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788581283.651951:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184149760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581283.651961:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581283.651963:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150784 00000100:00100000:0.0:1788581283.651970:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150784 00000100:00100000:3.0:1788581283.651989:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184149760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.651996:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788581283.652006:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151296 00000100:00100000:0.0:1788581283.652010:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151296 00000100:00100000:3.0:1788581283.652022:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788581283.652031:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.652074:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184150784:12345-0@lo:400:kworker.0 Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.652162:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150656 00000100:00100000:1.0:1788581283.652167:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150656 00000100:00100000:1.0:1788581283.652195:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151168 00000100:00100000:1.0:1788581283.652198:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151168 00000100:00100000:1.0:1788581283.652215:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150272 00000100:00100000:1.0:1788581283.652217:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150272 00000100:00100000:1.0:1788581283.652230:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788581283.652237:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184150656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652466:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184150400:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652496:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.652527:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184150912:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652548:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.652563:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184151424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652579:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.652591:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581283.652597:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184150016:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652614:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.652622:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184150528:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652637:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.652644:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184151040:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.652658:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581283.652720:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184150656:12345-0@lo:400:kworker.0 Request processed in 483us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.652727:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788581283.652742:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150016 00000100:00100000:1.0:1788581283.652745:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150016 00000100:00100000:1.0:1788581283.652757:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150528 00000100:00100000:1.0:1788581283.652759:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150528 00000100:00100000:1.0:1788581283.652768:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151040 00000100:00100000:1.0:1788581283.652770:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151040 00000100:00100000:1.0:1788581283.652791:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788581283.653220:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150144 00000100:00100000:2.0:1788581283.653224:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150144 00000100:00100000:2.0:1788581283.653273:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150400 00000100:00100000:2.0:1788581283.653277:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150400 00000100:00100000:2.0:1788581283.653427:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581283.653435:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184150144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.653484:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184150144:12345-0@lo:400:kworker.0 Request processed in 50us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.653491:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581283.653518:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581283.653525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184150400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.653557:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184150400:12345-0@lo:400:kworker.0 Request processed in 33us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581283.653563:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581283.653583:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184150912 00000100:00100000:2.0:1788581283.653587:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184150912 00000100:00100000:1.0:1788581283.653631:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581283.653667:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184151168:12345-0@lo:400:kworker.0 Request processed in 870us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.653673:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788581283.653685:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788581283.653691:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184150272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581283.653713:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184150272:12345-0@lo:400:kworker.0 Request processed in 23us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.653718:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788581283.653728:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788581283.653734:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581283.653777:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184150016:12345-0@lo:400:kworker.0 Request processed in 43us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.653782:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788581283.653792:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788581283.653798:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184150528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581283.653825:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184150528:12345-0@lo:400:kworker.0 Request processed in 27us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.653831:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788581283.653842:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788581283.653890:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581283.653894:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151424 00000100:00100000:0.0:1788581283.653900:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151424 00000100:00100000:3.0:1788581283.653914:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581283.653924:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.653960:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184151296:12345-0@lo:400:kworker.0 Request processed in 39us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.653966:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788581283.653984:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581283.653995:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581283.653998:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581283.654000:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788581283.654048:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432bfb80 x1875463184149760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581283.654061:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581283.654072:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.654073:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184149760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581283.654093:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184150272:0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654105:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13800 x1875463184150784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581283.654115:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184150784:0@lo:400:kworker.0 00000100:00100000:0.0:1788581283.654121:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184151424:12345-0@lo:400:kworker.0 Request processed in 51us (1539us total) trans 0 rc 0/0 00010000:00080000:3.0:1788581283.654128:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13100 x1875463184151296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581283.654132:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788581283.654143:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184151296:0@lo:400:kworker.0 00000100:00100000:0.0:1788581283.654161:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184149888 00000100:00100000:0.0:1788581283.654167:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184149888 00000100:00100000:3.0:1788581283.654170:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184150144:0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654187:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e12a00 x1875463184150656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581283.654197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184150656:0@lo:400:kworker.0 00000100:00100000:0.0:1788581283.654198:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788581283.654211:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184149888:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654217:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e11500 x1875463184151168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581283.654226:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184151168:0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654239:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395f80 x1875463184149632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581283.654251:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184149888:12345-0@lo:400:kworker.0 Request processed in 41us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.654270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184149632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581283.654276:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788581283.654425:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581283.654546:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184151040:12345-0@lo:400:kworker.0 Request processed in 698us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581283.654558:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788581283.654833:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581283.654843:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.654852:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184150016:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.654867:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184150528:0@lo:400:kworker.0 00000100:00100000:3.0:1788581283.654882:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184151040:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.654889:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184150912:12345-0@lo:400:kworker.0 Request processed in 48us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581283.654895:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184149888:0@lo:400:kworker.0 00000100:00100000:2.0:1788581283.654898:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788581283.654915:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184150400:0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654927:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e11180 x1875463184150912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581283.654935:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184150912:0@lo:400:kworker.0 00010000:00080000:3.0:1788581283.654944:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e11f80 x1875463184151424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581283.654952:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184151424:0@lo:400:kworker.0 00000001:00100000:1.0:1788581283.659175:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000020:00000080:1.0:1788581283.659184:0:8400:0:(genops.c:885:class_export_put()) final put ffff995e7faa5000/4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00100000:1.0:1788581283.659569:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000020:00000080:1.0:1788581283.659574:0:9486:0:(genops.c:885:class_export_put()) final put ffff995e6f941800/4d3903fb-7514-43fd-b94a-0d806aeb9639 00000020:00000080:3.0:1788581283.659649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7faa5000/4d3903fb-7514-43fd-b94a-0d806aeb9639 for lustre-OST0000 00000020:00000080:3.0:1788581283.659702:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f941800/4d3903fb-7514-43fd-b94a-0d806aeb9639 for lustre-OST0001 00000020:00000080:3.0:1788581283.659718:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7faa6800 for lustre-OST0000 00000020:00000080:3.0:1788581283.659723:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f942800 for lustre-OST0001 00000020:00000080:1.0:1788581284.111570:0:13158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3139f8b0 20000000:00000080:1.0:1788581284.111588:0:13158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e6f969000 uarg=0000000000000000 20000000:01000000:1.0:1788581284.111631:0:13158:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581284.111636:0:13158:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581284.111641:0:13158:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788581284.113218:0:13159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788581284.114026:0:13158:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788581284.131017:0:13158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788581284.131047:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131067:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131077:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131084:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131090:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131095:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.131102:0:13158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.132211:0:13158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.132298:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.132313:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 12 pid: 6487 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.132336:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151552:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581284.132438:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.132447:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 23 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.132457:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151680:0@lo:104: 00000100:00100000:1.0:1788581284.134680:0:13158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581284.134745:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.134758:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.134771:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151808:0@lo:104: 00000100:00100000:1.0:1788581284.134808:0:13158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581284.134837:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.134859:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.134868:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151936:0@lo:104: 00000100:00100000:1.0:1788581284.134888:0:13158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581284.134903:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.134910:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 23 pid: 6488 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.134916:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184152064:0@lo:104: 00000100:00100000:0.0:1788581284.135044:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151680 00000100:00100000:0.0:1788581284.135096:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151680 00000100:00100000:0.0:1788581284.135197:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151808 00000100:00100000:0.0:1788581284.135200:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151808 00000100:00100000:0.0:1788581284.135210:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184151936 00000100:00100000:0.0:1788581284.135211:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184151936 00000100:00100000:0.0:1788581284.135221:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581284.135228:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:13158:x1875463184151680:12345-0@lo:104: 00010000:00010000:0.0:1788581284.135239:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.135305:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581284.135310:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:13158:x1875463184151680:12345-0@lo:104: Request processed in 83us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.135317:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581284.135421:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581284.135430:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:13158:x1875463184151808:12345-0@lo:104: 00010000:00010000:2.0:1788581284.135440:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.135549:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581284.135555:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:13158:x1875463184151808:12345-0@lo:104: Request processed in 127us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581284.135561:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581284.135638:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581284.135645:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13158:x1875463184151936:12345-0@lo:104: 00010000:00010000:2.0:1788581284.135660:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.135695:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788581284.135700:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13158:x1875463184151936:12345-0@lo:104: Request processed in 56us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581284.135706:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788581284.135722:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788581284.135727:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.135733:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581284.135738:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.135746:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581284.135753:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581284.135759:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581284.135793:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.135801:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581284.135820:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.135992:0:13158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581284.136027:0:13158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.136036:0:13158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.136046:0:13158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184152320:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581284.136169:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152064 00000100:00100000:0.0:1788581284.136173:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152064 00000100:00100000:0.0:1788581284.136191:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581284.136196:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13158:x1875463184152064:12345-0@lo:104: 00010000:00010000:0.0:1788581284.136204:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136233:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581284.136238:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13158:x1875463184152064:12345-0@lo:104: Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.136244:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788581284.136272:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581284.136276:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136292:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581284.136295:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136302:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581284.136307:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581284.136311:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581284.136343:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136349:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581284.136364:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136371:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b2fc3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc43 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136385:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581284.136388:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136393:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581284.136396:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136412:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581284.136418:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581284.136423:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581284.136437:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136442:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581284.136448:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136455:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5e00/0x50f0cc74b7b2fc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc35 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136464:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581284.136466:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.136471:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e82160c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581284.136474:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.136724:0:13158:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581284.136741:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151680:0@lo:104: 00000100:00100000:1.0:1788581284.136749:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151808:0@lo:104: 00000100:00100000:1.0:1788581284.136756:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151936:0@lo:104: 00000100:00100000:1.0:1788581284.136761:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184152064:0@lo:104: 00010000:00010000:2.0:1788581284.136874:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b2fc4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.136889:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581284.136890:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581284.136892:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581284.136897:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581284.136907:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184152192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581284.136934:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581284.137080:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152192 00000100:00100000:1.0:1788581284.137089:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152192 00010000:00010000:1.0:1788581284.137108:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581284.137142:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581284.137149:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184152192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581284.137160:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581284.137165:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.137173:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.137185:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fc51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc4a expref: 24 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.137197:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581284.137221:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3621:x1875463184152192:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581284.137227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788581284.137287:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581284.137294:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581284.137304:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581284.137333:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137339:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581284.137352:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137359:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e82160c00/0x50f0cc74b7b2fc20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fc27 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137373:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581284.137375:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581284.137377:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581284.137387:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184152448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581284.137412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581284.137431:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581284.137436:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184152576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581284.137455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581284.137493:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184152704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581284.137524:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581284.137551:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152448 00000100:00100000:0.0:1788581284.137555:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152448 00010000:00010000:0.0:1788581284.137569:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 23 pid: 6486 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581284.137593:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152576 00000100:00100000:0.0:1788581284.137595:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152576 00010000:00010000:0.0:1788581284.137613:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 24 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581284.137622:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152704 00000100:00100000:0.0:1788581284.137625:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152704 00010000:00010000:0.0:1788581284.137633:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 25 pid: 6488 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581284.137642:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581284.137647:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+25:3618:x1875463184152448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581284.137654:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581284.137658:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 25 pid: 6486 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137666:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 25 pid: 6486 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137676:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b2fc43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc3c expref: 25 pid: 6486 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137684:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581284.137709:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184152448:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.137715:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581284.137726:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581284.137731:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3618:x1875463184152576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581284.137739:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581284.137743:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137762:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137772:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a400/0x50f0cc74b7b2fc35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc2e expref: 23 pid: 6487 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137780:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581284.137802:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3618:x1875463184152576:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.137808:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581284.137821:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581284.137827:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3620:x1875463184152704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581284.137836:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581284.137840:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 21 pid: 6488 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137848:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 21 pid: 6488 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137857:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b2fc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc20 expref: 21 pid: 6488 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.137866:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581284.137894:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184152704:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.137900:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581284.137926:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184152576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581284.137932:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184152448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581284.138083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184152704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581284.138444:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184152192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581284.138565:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581284.138626:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184151552:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581284.138751:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442752 00000100:00100000:0.0:1788581284.138756:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442752 00010000:00010000:0.0:1788581284.138775:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581284.138805:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1788581284.138813:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170442752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581284.138821:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581284.138825:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.138834:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.138845:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b2fc66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f2a expref: 13 pid: 6487 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.138854:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581284.138891:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:2396:x1875463170442752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.138897:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1788581284.139208:0:13158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13158:1875463184152320:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581284.139237:0:13158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581284.147336:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581284.147384:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170442880 00000100:00100000:0.0:1788581284.147393:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170442880 00010000:00010000:0.0:1788581284.147432:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581284.147485:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1788581284.147507:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:2396:x1875463170442880:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581284.147538:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581284.147545:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147558:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147584:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5c00/0x50f0cc74b7b2fc19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21eeb expref: 12 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147602:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147610:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147626:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147634:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147641:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147647:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147653:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581284.147657:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147674:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147696:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581284.147708:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581284.147761:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2396:x1875463170442880:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 266us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581284.147769:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00010000:00010000:1.0:1788581284.147962:0:13158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.147974:0:13158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581284.147992:0:13158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b2fc89 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581284.553109:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581284.673451:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581284.673472:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184152832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581284.673549:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581284.673663:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152832 00000100:00100000:1.0:1788581284.673671:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152832 00000100:00100000:1.0:1788581284.673723:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788581284.673733:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184152832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581284.673763:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581284.673830:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184152832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581284.673836:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581284.673916:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184152832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581285.544578:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581285.544710:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443008 00000100:00100000:3.0:1788581285.544721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443008 00000100:00100000:3.0:1788581285.544775:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:3.0:1788581285.544786:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+11:6163:x1875463170443008:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581285.544810:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581285.544828:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21f5b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.544854:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.544865:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.544875:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5a00, rc 0) 00000100:00100000:3.0:1788581285.544935:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443008:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.544942:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:0.0:1788581285.558535:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581285.558569:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443136 00000100:00100000:0.0:1788581285.558577:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443136 00000100:00100000:0.0:1788581285.558623:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:0.0:1788581285.558632:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443136:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.558772:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443136:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 140us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581285.558780:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:2.0:1788581285.568409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581285.568555:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443264 00000100:00100000:3.0:1788581285.568566:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443264 00000100:00100000:3.0:1788581285.568689:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 312 00000100:00100000:3.0:1788581285.568700:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443264:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.568842:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443264:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 143us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.568850:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 312 00010000:00010000:3.0:1788581285.575019:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581285.575981:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581285.576139:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443392 00000100:00100000:3.0:1788581285.576149:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443392 00000100:00100000:3.0:1788581285.576204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00100000:3.0:1788581285.576214:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170443392:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581285.576230:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581285.576269:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21f62 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.576308:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.576319:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.576329:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4a00, rc 0) 00000100:00100000:3.0:1788581285.576387:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170443392:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 174us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.576394:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00100000:2.0:1788581285.581614:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581285.581702:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443520 00000100:00100000:3.0:1788581285.581713:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443520 00000100:00100000:3.0:1788581285.581769:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 314 00000100:00100000:3.0:1788581285.581781:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170443520:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.581993:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170443520:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 213us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.582001:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 314 00000100:00100000:2.0:1788581285.596399:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581285.596519:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443648 00000100:00100000:1.0:1788581285.596528:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443648 00000100:00100000:3.0:1788581285.596672:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 315 00000100:00100000:3.0:1788581285.596684:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170443648:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.596913:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170443648:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 231us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.596931:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 315 10000000:01000000:1.0:1788581285.825663:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581285.825670:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f944800 from 7 10000000:01000000:1.0:1788581285.825675:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581285.825729:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.825742:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.825754:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581285.825778:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184152960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.825846:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581285.825899:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581285.826892:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184152960 00000100:00100000:3.0:1788581285.826901:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184152960 00000100:00100000:3.0:1788581285.826964:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788581285.826974:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184152960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581285.826987:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581285.827001:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fc9e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.827026:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.827037:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.827045:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5400, rc 0) 00000100:00100000:3.0:1788581285.827112:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184152960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.827119:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788581285.827206:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184152960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581285.827222:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.827242:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581285.827406:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4391b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.827439:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581285.827545:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581285.827598:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153088 00000100:00100000:3.0:1788581285.827602:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153088 00000100:00100000:3.0:1788581285.827636:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788581285.827643:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184153088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.828549:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184153088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 829us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.828558:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788581285.828654:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4391b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.828694:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4391b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.828812:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581285.828846:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.828871:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153216 00000100:00100000:1.0:1788581285.828878:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153216 00000100:00100000:1.0:1788581285.828918:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788581285.828927:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184153216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.829034:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184153216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.829041:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788581285.829169:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4391b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581285.830182:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788581285.830864:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788581285.830889:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581285.830899:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.830924:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581285.830934:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581285.830936:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f8e1800 from 7 10000000:01000000:3.0:1788581285.830940:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581285.830971:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.830979:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.830989:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581285.831010:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.831061:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.831107:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581285.831236:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153344 00000100:00100000:0.0:1788581285.831243:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153344 00000100:00100000:0.0:1788581285.831375:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788581285.831384:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184153344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581285.831396:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581285.831407:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fcac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.831428:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.831437:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.831445:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e82161800, rc 0) 00000100:00100000:0.0:1788581285.831482:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581285.833344:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581285.833369:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.833381:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581285.833473:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.833532:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.833577:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581285.833726:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788581285.833758:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153472 00000100:00100000:0.0:1788581285.833763:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153472 00000100:00100000:0.0:1788581285.833791:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788581285.833800:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.833909:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581285.833916:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788581285.834062:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.834092:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.834130:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.834151:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.835534:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153600 00000100:00100000:1.0:1788581285.835544:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153600 00000100:00100000:1.0:1788581285.835587:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788581285.835596:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.835736:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.835743:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788581285.836061:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581285.837107:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788581285.837409:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788581285.837435:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581285.837444:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.837466:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581285.837477:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581285.837479:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4f1e6000 from 7 10000000:01000000:3.0:1788581285.837482:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581285.837523:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.837530:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.837539:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581285.837560:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.837610:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.837659:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.838040:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153728 00000100:00100000:1.0:1788581285.838048:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153728 00000100:00100000:1.0:1788581285.838129:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788581285.838139:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184153728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581285.838151:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581285.838164:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fcba expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.838186:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.838196:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.838212:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b400, rc 0) 00000100:00100000:1.0:1788581285.838290:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184153728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.838297:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788581285.838373:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581285.838387:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581285.838395:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581285.838461:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.838502:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.838875:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581285.838920:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153856 00000100:00100000:0.0:1788581285.838924:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153856 00000100:00100000:0.0:1788581285.838950:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788581285.838957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184153856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.839065:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184153856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581285.839071:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788581285.839213:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.841392:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581285.841476:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581285.841521:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.843208:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184153984 00000100:00100000:1.0:1788581285.843218:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184153984 00000100:00100000:1.0:1788581285.843419:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788581285.843430:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184153984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.843584:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184153984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.843592:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788581285.843727:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184153984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788581285.844652:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788581285.846184:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788581285.846216:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581285.846396:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.846409:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581285.846420:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581285.846423:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3a800 from 7 10000000:01000000:0.0:1788581285.846426:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581285.846459:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.846473:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581285.846494:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581285.846520:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581285.846578:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581285.847517:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581285.853670:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154112 00000100:00100000:2.0:1788581285.853683:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154112 00000100:00100000:2.0:1788581285.853750:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788581285.853762:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184154112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581285.853779:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581285.853796:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fcc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581285.853822:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581285.853841:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581285.853851:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:2.0:1788581285.853933:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184154112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (7354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581285.853940:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788581285.854694:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581285.854725:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581285.854736:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581285.854808:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.854846:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581285.854874:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.854893:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154240 00000100:00100000:1.0:1788581285.854897:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154240 00000100:00100000:1.0:1788581285.855029:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788581285.855039:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184154240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.855157:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184154240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.855163:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788581285.855191:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.855213:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.855249:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581285.855410:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581285.855421:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154368 00000100:00100000:1.0:1788581285.855424:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154368 00000100:00100000:1.0:1788581285.855444:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788581285.855449:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184154368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581285.855525:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184154368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581285.855532:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788581285.855567:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184154368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581285.856879:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788581285.857169:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788581285.857193:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581285.857204:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581285.857214:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581286.593529:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581286.725340:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184154496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581286.725402:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581286.725743:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184154624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581286.725775:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581286.725853:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154496 00000100:00100000:3.0:1788581286.725869:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154496 00000100:00100000:3.0:1788581286.725934:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154624 00000100:00100000:3.0:1788581286.725946:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154624 00000100:00100000:3.0:1788581286.725963:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581286.725979:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184154496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581286.726006:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581286.726060:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184154496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581286.726066:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581286.726089:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581286.726096:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184154624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581286.726123:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581286.726167:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184154624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581286.726173:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788581286.726195:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581286.726665:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b2a1880 x1875463184154496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581286.726686:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184154496:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788581286.728551:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395f80 x1875463184154624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581286.728573:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184154624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581287.234062:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184154752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581287.234128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581287.234182:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154752 00000100:00100000:3.0:1788581287.234191:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154752 00000100:00100000:3.0:1788581287.234250:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581287.234377:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184154752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581287.234410:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581287.234592:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184154752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 215us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581287.234600:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788581287.237241:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184154752:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788581287.617380:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581287.713469:0:13356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788581288.641414:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581288.681700:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581288.681737:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581288.681773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581288.681893:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443904 00000100:00100000:3.0:1788581288.681910:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443904 00000100:00100000:3.0:1788581288.681959:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444160 00000100:00100000:3.0:1788581288.681962:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444160 00000100:00100000:3.0:1788581288.681982:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:3.0:1788581288.681990:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170443904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581288.682055:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170443904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 65us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581288.682063:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:3.0:1788581288.682078:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:3.0:1788581288.682085:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170444160:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581288.682110:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170444160:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581288.682131:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00080000:3.0:1788581288.682148:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581288.682566:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581288.682588:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581288.682763:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444032 00000100:00100000:1.0:1788581288.682769:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444032 00000100:00100000:1.0:1788581288.682826:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444288 00000100:00100000:1.0:1788581288.682829:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444288 00000100:00100000:1.0:1788581288.682847:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1788581288.682854:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170444032:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581288.682890:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170444032:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.682907:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1788581288.682920:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:1.0:1788581288.682927:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170444288:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581288.682952:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170444288:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.682957:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00080000:2.0:1788581288.683550:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581288.685076:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170443776 00000100:00100000:0.0:1788581288.685088:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170443776 00000100:00100000:0.0:1788581288.685214:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:0.0:1788581288.685224:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170443776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581288.685328:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170443776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 105us (3553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581288.685336:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:1.0:1788581288.769739:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184155264:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.769804:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.769845:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184155776:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.769869:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.769887:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184156288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.769906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.769935:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788581288.769941:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184154880:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.769968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.769988:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184155392:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770019:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770035:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184155904:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770052:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770063:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184156416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770106:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184155136:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770128:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770144:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184155648:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770173:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184156160:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770188:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770202:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788581288.770207:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184155008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770222:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770234:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184155520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770249:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184156032:0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.770303:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581288.770394:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184154880 00000100:00100000:2.0:1788581288.770403:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184154880 00000100:00100000:2.0:1788581288.770448:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788581288.770458:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184154880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581288.770488:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184156544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581288.770532:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184154880:12345-0@lo:400:kworker.0 Request processed in 75us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581288.770537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581288.770550:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788581288.770578:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155776 00000100:00100000:0.0:1788581288.770583:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155776 00000100:00100000:2.0:1788581288.770591:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156288 00000100:00100000:2.0:1788581288.770597:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156288 00000100:00100000:0.0:1788581288.770618:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155904 00000100:00100000:0.0:1788581288.770623:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155904 00000100:00100000:2.0:1788581288.770624:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156416 00000100:00100000:2.0:1788581288.770629:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156416 00000100:00100000:0.0:1788581288.770645:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788581288.770654:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184155776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581288.770700:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184155776:12345-0@lo:400:kworker.0 Request processed in 48us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.770747:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155264 00000100:00100000:1.0:1788581288.770752:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155264 00000100:00100000:1.0:1788581288.770773:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155648 00000100:00100000:1.0:1788581288.770775:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155648 00000100:00100000:1.0:1788581288.770790:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156160 00000100:00100000:1.0:1788581288.770794:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156160 00000100:00100000:1.0:1788581288.770811:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155008 00000100:00100000:1.0:1788581288.770814:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155008 00000100:00100000:3.0:1788581288.770830:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184156672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581288.770839:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155520 00000100:00100000:1.0:1788581288.770843:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155520 00000100:00100000:1.0:1788581288.770857:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156032 00000100:00100000:1.0:1788581288.770860:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156032 00000100:00100000:3.0:1788581288.770865:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581288.770882:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788581288.770892:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184155264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.770905:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156544 00000100:00100000:3.0:1788581288.770910:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156544 00000100:00100000:1.0:1788581288.770936:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184155264:12345-0@lo:400:kworker.0 Request processed in 46us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581288.770938:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156672 00000100:00100000:3.0:1788581288.770942:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156672 00000100:00100000:1.0:1788581288.770947:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788581288.770960:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581288.770969:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184156544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581288.770970:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788581288.770984:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184155648:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788581288.770995:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581288.771028:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184155648:12345-0@lo:400:kworker.0 Request processed in 47us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771036:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788581288.771040:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184156544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581288.771049:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581288.771055:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788581288.771063:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184156160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.771068:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788581288.771078:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184156672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581288.771090:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581288.771098:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184156160:12345-0@lo:400:kworker.0 Request processed in 35us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771105:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788581288.771118:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788581288.771125:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184156672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771127:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.771140:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581288.771162:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184155008:12345-0@lo:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771168:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788581288.771179:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788581288.771184:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184155520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.771216:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184155520:12345-0@lo:400:kworker.0 Request processed in 32us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771222:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788581288.771231:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788581288.771236:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184156032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581288.771285:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184156032:12345-0@lo:400:kworker.0 Request processed in 48us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581288.771291:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788581288.772681:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581288.772694:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184156288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.772760:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184156288:12345-0@lo:400:kworker.0 Request processed in 69us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581288.772766:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581288.772784:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581288.772791:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184155904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.772820:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184155904:12345-0@lo:400:kworker.0 Request processed in 31us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581288.772825:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581288.772837:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581288.772843:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184156416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.772872:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184156416:12345-0@lo:400:kworker.0 Request processed in 30us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581288.772877:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581288.772937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184154880:0@lo:400:kworker.0 00010000:00080000:2.0:1788581288.772956:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4e00 x1875463184155904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581288.772968:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184155904:0@lo:400:kworker.0 00010000:00080000:2.0:1788581288.772983:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4380 x1875463184156416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581288.773001:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184156416:0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.773017:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184155264:0@lo:400:kworker.0 00010000:00080000:2.0:1788581288.773030:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4700 x1875463184155776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581288.773037:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184155776:0@lo:400:kworker.0 00010000:00080000:2.0:1788581288.773048:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b7480 x1875463184156288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581288.773055:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184156288:0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.773153:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155392 00000100:00100000:2.0:1788581288.773159:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155392 00000100:00100000:2.0:1788581288.773189:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184155136 00000100:00100000:2.0:1788581288.773193:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184155136 00000100:00100000:2.0:1788581288.773210:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788581288.773216:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184155392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581288.773292:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184155392:12345-0@lo:400:kworker.0 Request processed in 75us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581288.773299:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788581288.773313:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788581288.773333:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184155136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.773578:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184155392:0@lo:400:kworker.0 00000100:00080000:3.0:1788581288.773631:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581288.773636:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581288.773643:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581288.773646:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581288.774014:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581288.774769:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184155136:12345-0@lo:400:kworker.0 Request processed in 1445us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581288.774777:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1788581288.774843:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43394000 x1875463184156672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581288.774874:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184156672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581288.774892:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184155008:0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.774905:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184155520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.774916:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184156032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581288.774927:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184155136:0@lo:400:kworker.0 00010000:00080000:3.0:1788581288.774942:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b5500 x1875463184155648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581288.774952:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184155648:0@lo:400:kworker.0 00010000:00080000:3.0:1788581288.774963:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b7800 x1875463184156160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581288.774971:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184156160:0@lo:400:kworker.0 00010000:00080000:0.0:1788581288.775043:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43395c00 x1875463184156544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581288.775057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184156544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581289.666090:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581289.793585:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184156800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581289.793666:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581289.793871:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156800 00000100:00100000:0.0:1788581289.793879:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156800 00000100:00100000:0.0:1788581289.793958:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788581289.793967:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184156800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581289.793999:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581289.794052:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184156800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581289.794058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788581289.794136:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184156800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581290.690479:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581291.713585:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581291.841462:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581291.841483:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184156928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581291.841550:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581291.841611:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184156928 00000100:00100000:3.0:1788581291.841618:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184156928 00000100:00100000:3.0:1788581291.841665:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788581291.841673:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184156928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581291.841699:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581291.841740:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184156928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581291.841757:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788581291.841778:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581291.841804:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43394000 x1875463184156928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581291.841823:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184156928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581291.841885:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184157056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581291.841911:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581291.842038:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157056 00000100:00100000:2.0:1788581291.842123:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157056 00000100:00100000:2.0:1788581291.842198:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581291.842206:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184157056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581291.842218:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581291.842250:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184157056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581291.842270:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788581291.842321:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581291.842341:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b2a1c00 x1875463184157056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581291.842354:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184157056:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788581291.998022:0:13505:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:08:10 (1788581290) === 00000100:00100000:2.0:1788581292.287893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.287943:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581292.288039:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444544 00000100:00100000:1.0:1788581292.288049:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444544 00000100:00100000:1.0:1788581292.288117:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1788581292.288128:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:10477:x1875463170444544:12345-192.168.203.3@tcp:700:mkdir.0 00000100:00080000:0.0:1788581292.288201:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581292.288207:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:10477:x1875463170444544:12345-192.168.203.3@tcp:700:mkdir.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.288216:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1788581292.289127:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444416 00000100:00100000:3.0:1788581292.289135:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444416 00000100:00100000:3.0:1788581292.289391:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1788581292.289401:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170444416:12345-192.168.203.3@tcp:41:mkdir.0 00000004:00000024:3.0:1788581292.289432:0:11562:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581292.289515:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170444416:12345-192.168.203.3@tcp:41:mkdir.0 Request processed in 115us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.289533:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1788581292.295206:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.296232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444800 00000100:00100000:2.0:1788581292.296244:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444800 00000100:00100000:2.0:1788581292.296517:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1788581292.296530:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:10477:x1875463170444800:12345-192.168.203.3@tcp:36:mkdir.0 00010000:00010000:2.0:1788581292.296594:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581292.296646:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b2fb78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ed6 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296690:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659c00) 00010000:00010000:2.0:1788581292.296710:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581292.296791:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296804:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296813:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296836:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296843:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.296848:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297395:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297406:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297413:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581292.297428:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000606fc09a reply state 00000000733d29da transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297438:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297456:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:2.0:1788581292.297459:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581292.297462:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788581292.297466:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581292.297472:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297478:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297490:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297496:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.297501:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297508:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297517:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4203bf00) 00010000:00010000:2.0:1788581292.297519:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.297522:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297528:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fcd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581292.297542:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000606fc09a reply state 00000000733d29da transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297550:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.297555:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995d4203b200) 00010000:00010000:2.0:1788581292.297557:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581292.297559:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788581292.297644:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:10477:x1875463170444800:12345-192.168.203.3@tcp:36:mkdir.0 Request processed in 1116us (2446us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788581292.297651:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1788581292.316781:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.316883:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170444928 00000100:00100000:2.0:1788581292.316893:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170444928 00000100:00100000:2.0:1788581292.316956:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581292.316967:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:10478:x1875463170444928:12345-192.168.203.3@tcp:101:chmod.0 00010000:00010000:2.0:1788581292.316989:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.317010:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f69 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317075:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317089:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317101:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.317144:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788581292.317148:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581292.317188:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317415:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f69 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317437:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f69 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.317456:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4203bf00) 00010000:00010000:2.0:1788581292.317459:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581292.317475:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273200, rc 0) 00000100:00100000:2.0:1788581292.317539:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:10478:x1875463170444928:12345-192.168.203.3@tcp:101:chmod.0 Request processed in 573us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581292.317546:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1788581292.319986:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.321374:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445184 00000100:00100000:3.0:1788581292.321392:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445184 00000100:00100000:3.0:1788581292.321561:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581292.321576:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:10478:x1875463170445184:12345-192.168.203.3@tcp:36:chmod.0 00010000:00010000:3.0:1788581292.321670:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581292.321704:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fcf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f69 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.321736:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4203bf00) 00010000:00010000:3.0:1788581292.321747:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581292.321781:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.321795:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.321807:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581292.322569:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079e0b906 reply state 000000009f4321a1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.322587:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.322594:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:3.0:1788581292.322597:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788581292.322600:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788581292.322611:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788581292.322774:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:10478:x1875463170445184:12345-192.168.203.3@tcp:36:chmod.0 Request processed in 1200us (2797us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788581292.322782:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1788581292.342388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.342854:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445312 00000100:00100000:2.0:1788581292.342962:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445312 00000100:00100000:2.0:1788581292.343093:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581292.343106:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:10479:x1875463170445312:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:2.0:1788581292.343141:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.343168:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f70 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343316:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343334:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343347:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.343397:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788581292.343400:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581292.343459:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343493:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f70 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343517:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f70 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.343544:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:2.0:1788581292.343547:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581292.343552:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273200, rc 0) 00000100:00100000:2.0:1788581292.343640:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:10479:x1875463170445312:12345-192.168.203.3@tcp:101:chown.0 Request processed in 535us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581292.343647:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1788581292.346623:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.346683:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445440 00000100:00100000:3.0:1788581292.346697:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445440 00000100:00100000:3.0:1788581292.346791:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1788581292.346803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:10479:x1875463170445440:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:3.0:1788581292.346836:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581292.346871:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f77 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.346965:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.346982:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.346994:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347013:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347018:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347023:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347115:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347120:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347124:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581292.347176:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581292.347179:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581292.347200:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347211:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347216:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347221:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347224:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581292.347227:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347232:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347243:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:3.0:1788581292.347245:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581292.347248:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347631:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347653:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347680:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347688:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347692:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581292.347696:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347702:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347714:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995d4203b200) 00010000:00010000:3.0:1788581292.347717:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581292.347720:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347726:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347772:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f77 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347795:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f77 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.347803:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:3.0:1788581292.347805:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581292.347819:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5e00, rc 0) 00000100:00100000:3.0:1788581292.348337:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10479:x1875463170445440:12345-192.168.203.3@tcp:101:chown.0 Request processed in 1532us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.348346:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581292.351795:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.352019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445568 00000100:00100000:3.0:1788581292.352032:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445568 00000100:00100000:3.0:1788581292.352174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581292.352188:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10479:x1875463170445568:12345-192.168.203.3@tcp:900:chown.0 00000100:00100000:3.0:1788581292.352435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10479:x1875463170445568:12345-192.168.203.3@tcp:900:chown.0 Request processed in 248us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.352458:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1788581292.353665:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184157184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581292.353747:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581292.354362:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157184 00000100:00100000:1.0:1788581292.354374:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157184 00000100:00100000:1.0:1788581292.354437:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788581292.354648:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184157184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581292.354686:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788581292.354785:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184157184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.354793:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788581292.355069:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184157184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581292.356655:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.357241:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445824 00000100:00100000:3.0:1788581292.357415:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445824 00000100:00100000:3.0:1788581292.357569:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581292.357582:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10479:x1875463170445824:12345-192.168.203.3@tcp:36:chown.0 00010000:00010000:3.0:1788581292.357656:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581292.357689:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f77 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.357713:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:3.0:1788581292.357718:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581292.357746:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.357760:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.357770:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581292.367212:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788581292.367441:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015c6dc6c reply state 0000000050e4766b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.367485:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.367497:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:3.0:1788581292.367500:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788581292.367505:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788581292.367522:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788581292.367665:0:11562:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788581292.367690:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:10479:x1875463170445824:12345-192.168.203.3@tcp:36:chown.0 Request processed in 10105us (11040us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788581292.367701:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00010000:00010000:0.0:1788581292.368560:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368591:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368598:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368605:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581292.368611:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368619:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368637:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:0.0:1788581292.368640:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581292.368644:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.368650:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369920:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369936:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369944:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369950:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.369954:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369961:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.369976:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995d4203b200) 00010000:00010000:2.0:1788581292.369980:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.369984:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.370008:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fcdd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.370036:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.370043:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.370049:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371837:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.371845:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371857:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371881:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:2.0:1788581292.371884:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.371890:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371898:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fce4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371942:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371950:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371979:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371984:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.371988:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.371994:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.372004:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:2.0:1788581292.372006:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581292.372010:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.372016:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fcf9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581292.387081:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.387188:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170445952 00000100:00100000:2.0:1788581292.387198:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170445952 00000100:00100000:2.0:1788581292.387295:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1788581292.387305:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:10480:x1875463170445952:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:2.0:1788581292.387332:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.387352:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f7e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581292.389350:0:6494:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1933us 00010000:00010000:3.0:1788581292.415078:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.415101:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.415112:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.415129:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.415136:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.415143:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.416223:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.416238:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.416246:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581292.417493:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581292.417501:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581292.417547:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417563:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417570:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417577:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417582:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581292.417586:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417593:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417608:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:1.0:1788581292.417611:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581292.417616:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417622:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5e00/0x50f0cc74b7b2fd38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417646:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417652:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417658:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417664:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581292.417667:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417672:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417681:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995e6f928300) 00010000:00010000:1.0:1788581292.417684:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581292.417687:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417692:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b2fd3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417736:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f7e expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417766:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f7e expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.417789:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:1.0:1788581292.417791:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788581292.417794:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5c00, rc 0) 00000100:00100000:1.0:1788581292.417873:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:10480:x1875463170445952:12345-192.168.203.3@tcp:101:touch.500 Request processed in 30568us (30799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.417881:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1788581292.425648:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.425901:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170446208 00000100:00100000:3.0:1788581292.425913:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170446208 00000100:00100000:3.0:1788581292.425980:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581292.425991:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:10480:x1875463170446208:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:3.0:1788581292.426012:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581292.426031:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f85 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426137:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426151:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426162:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426570:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426578:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.426599:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581292.427886:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788581292.428693:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fd62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428709:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428719:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428752:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428758:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428764:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428770:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581292.428774:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428780:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428792:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:3.0:1788581292.428794:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581292.428805:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428811:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b2fd54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581292.428825:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055e88f53 reply state 00000000e98a25a8 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428837:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428843:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff995e6f928000) 00010000:00010000:3.0:1788581292.428846:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581292.428849:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581292.428887:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b2fd4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f85 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428902:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fd62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f85 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.428910:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581292.428912:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581292.428915:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e429c3e00, rc 0) 00000100:00100000:3.0:1788581292.428982:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:10480:x1875463170446208:12345-192.168.203.3@tcp:101:touch.500 Request processed in 2993us (3344us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788581292.428991:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581292.442172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581292.442288:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170446464 00000100:00100000:1.0:1788581292.442298:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170446464 00000100:00100000:1.0:1788581292.442357:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1788581292.442367:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:10480:x1875463170446464:12345-192.168.203.3@tcp:36:touch.500 00010000:00010000:1.0:1788581292.442433:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581292.442471:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fd62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f85 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.442873:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581292.442888:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581292.442962:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.442975:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.442985:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581292.443086:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000808b2547 reply state 000000008a3175c7 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.443104:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.443111:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:1.0:1788581292.443114:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581292.443116:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581292.443339:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10480:x1875463170446464:12345-192.168.203.3@tcp:36:touch.500 Request processed in 972us (1176us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788581292.443348:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1788581292.450392:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.450580:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170446592 00000100:00100000:2.0:1788581292.450604:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170446592 00000100:00100000:2.0:1788581292.450714:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1788581292.450726:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:10480:x1875463170446592:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:2.0:1788581292.450751:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.450769:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.450829:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f8c expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.450974:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f8c expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.450996:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:2.0:1788581292.450999:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581292.451003:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:2.0:1788581292.451067:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:10480:x1875463170446592:12345-192.168.203.3@tcp:101:touch.500 Request processed in 344us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581292.451074:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1788581292.455147:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581292.455233:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170446720 00000100:00100000:0.0:1788581292.455241:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170446720 00000100:00100000:0.0:1788581292.455314:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581292.455322:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170446720:12345-192.168.203.3@tcp:8:touch.500 00010000:00080000:0.0:1788581292.455358:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1788581292.455400:0:8410:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2fd7e 00002000:00100000:0.0:1788581292.455425:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36c1c238-f3ab-41d9-b90e-c3af2be29807/ffff995d42e98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581292.455453:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788581292.455768:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788581292.455798:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e7faa2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581292.455864:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170446720:12345-192.168.203.3@tcp:8:touch.500 Request processed in 541us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.455880:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1788581292.461096:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581292.461191:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170446848 00000100:00100000:0.0:1788581292.461200:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170446848 00000100:00100000:0.0:1788581292.461280:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1788581292.461290:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170446848:12345-192.168.203.3@tcp:2:touch.500 00000100:00080000:3.0:1788581292.461650:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788581292.471198:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788581292.471220:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000100:00100000:2.0:1788581292.475668:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:0:x1875463170446848:12345-192.168.203.3@tcp:2:touch.500 Request processed in 14366us (14567us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788581292.475684:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1788581292.481681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581292.482756:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170447104 00000100:00100000:0.0:1788581292.482773:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170447104 00000100:00100000:0.0:1788581292.482852:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1788581292.482865:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:10480:x1875463170447104:12345-192.168.203.3@tcp:35:touch.500 00000100:00100000:1.0:1788581292.483754:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:10480:x1875463170447104:12345-192.168.203.3@tcp:35:touch.500 Request processed in 886us (2083us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788581292.483767:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1788581292.501549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.501645:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170447232 00000100:00100000:3.0:1788581292.501672:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170447232 00000100:00100000:3.0:1788581292.501805:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1788581292.501818:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:10481:x1875463170447232:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1788581292.501844:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581292.501882:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2e00/0x50f0cc74b7b2fd85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f93 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.501958:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.501972:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.501983:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581292.502025:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581292.502029:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581292.502067:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.502095:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2e00/0x50f0cc74b7b2fd85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f93 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.502113:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f93 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.502123:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:3.0:1788581292.502126:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581292.502130:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e429c3a00, rc 0) 00000100:00100000:3.0:1788581292.502209:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:10481:x1875463170447232:12345-192.168.203.3@tcp:101:rm.0 Request processed in 394us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.502216:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1788581292.506083:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.508208:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170447488 00000100:00100000:3.0:1788581292.508222:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170447488 00000100:00100000:2.0:1788581292.508596:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1788581292.508609:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:10481:x1875463170447488:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1788581292.508631:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.508666:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fd93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21f9a expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.508762:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581292.510130:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fd93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f9a expref: 16 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.510150:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:2.0:1788581292.510153:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581292.510159:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fd93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f9a expref: 16 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.510177:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581292.510270:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:10481:x1875463170447488:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1646us (4178us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788581292.510278:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1788581292.515649:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.515764:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170447616 00000100:00100000:3.0:1788581292.515778:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170447616 00000100:00100000:3.0:1788581292.515857:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1788581292.515870:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:10481:x1875463170447616:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1788581292.527995:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:10481:x1875463170447616:12345-192.168.203.3@tcp:37:rm.0 Request processed in 11480us (11716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581292.528012:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1788581292.539140:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581292.539385:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170447872 00000100:00100000:1.0:1788581292.539397:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170447872 00000100:00100000:1.0:1788581292.539479:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1788581292.539491:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:10481:x1875463170447872:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1788581292.540077:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:10481:x1875463170447872:12345-192.168.203.3@tcp:35:rm.0 Request processed in 585us (946us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788581292.540087:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1788581292.550461:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.550599:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170448128 00000100:00100000:2.0:1788581292.550612:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170448128 00000100:00100000:2.0:1788581292.550695:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1788581292.550708:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:10481:x1875463170448128:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1788581292.550741:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.550767:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b2fda1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fa1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.552479:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fda8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.552524:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.552539:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.552558:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581292.552736:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b2fda1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa1 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.552762:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fda8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa1 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.552771:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:2.0:1788581292.552775:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581292.552779:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581292.552861:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448128:12345-192.168.203.3@tcp:101:rm.0 Request processed in 2155us (2425us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788581292.553508:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1788581292.558185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581292.558469:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170448256 00000100:00100000:3.0:1788581292.558482:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170448256 00000100:00100000:3.0:1788581292.558560:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:3.0:1788581292.558572:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448256:12345-192.168.203.3@tcp:41:rm.0 00000004:00000024:3.0:1788581292.558648:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788581292.558739:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448256:12345-192.168.203.3@tcp:41:rm.0 Request processed in 168us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.558747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1788581292.567418:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.570836:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170448384 00000100:00100000:2.0:1788581292.570858:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170448384 00000100:00100000:2.0:1788581292.571032:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1788581292.571046:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448384:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1788581292.571074:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581292.571099:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b2fdb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fa8 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.571210:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.571227:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.571241:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572151:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572167:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572177:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572333:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572342:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572349:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.572401:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788581292.572406:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581292.572428:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572470:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572480:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572486:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572494:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572500:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.572505:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572513:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572527:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:2.0:1788581292.572530:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.572535:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572541:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b2fdbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572558:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572564:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572575:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572581:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.572584:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572591:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572599:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff995e6f928000) 00010000:00010000:2.0:1788581292.572601:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.572604:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572610:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b2fdc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572648:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b2fdb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa8 expref: 20 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572662:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa8 expref: 19 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.572670:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:2.0:1788581292.572672:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581292.572674:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:2.0:1788581292.572841:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:10481:x1875463170448384:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1796us (5436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581292.572863:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:1.0:1788581292.587229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.591933:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170448640 00000100:00100000:2.0:1788581292.591958:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170448640 00000100:00100000:0.0:1788581292.592310:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1788581292.592324:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:10481:x1875463170448640:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1788581292.592398:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788581292.592432:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fdcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa8 expref: 19 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592481:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b2fd77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f8c expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592494:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:0.0:1788581292.592505:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fd8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f93 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592537:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:0.0:1788581292.592541:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581292.592567:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592593:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592603:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592616:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592623:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592630:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592765:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592774:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.592781:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581292.593078:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788581292.593092:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 278734837235ns, next at 279734833980ns, rc = 0 00010000:00010000:0.0:1788581292.593159:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593170:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593178:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593185:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593192:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593199:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593223:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.593248:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593318:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593325:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593331:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581292.593337:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593345:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593362:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:0.0:1788581292.593365:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788581292.593369:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593376:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2fde0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593393:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593400:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593405:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593409:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e82160c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581292.593412:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593418:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593425:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:0.0:1788581292.593427:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581292.593429:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593435:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160c00/0x50f0cc74b7b2fdd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581292.593471:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e42963e5 reply state 00000000e3d646f8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593483:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.593489:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff995e6f928000) 00010000:00010000:0.0:1788581292.593491:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581292.593494:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581292.593594:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448640:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1270us (6378us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788581292.593603:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00010000:00010000:1.0:1788581292.594022:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581292.594030:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.594038:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581292.594042:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.594049:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.594059:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:1.0:1788581292.594062:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581292.594065:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.594071:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2fde7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.594084:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.594086:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.594088:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581292.599571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.599673:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170448896 00000100:00100000:2.0:1788581292.599686:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170448896 00000100:00100000:2.0:1788581292.599757:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1788581292.599770:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170448896:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1788581292.600160:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:10481:x1875463170448896:12345-192.168.203.3@tcp:35:rm.0 Request processed in 391us (602us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788581292.600169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1788581292.608885:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581292.609061:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449152 00000100:00100000:2.0:1788581292.609074:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449152 00000100:00100000:2.0:1788581292.609191:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1788581292.609204:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:10481:x1875463170449152:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1788581292.609401:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788581292.609436:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b2fda8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fa1 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609479:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b2fd46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f7e expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609491:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995e6f928d00) 00010000:00010000:2.0:1788581292.609509:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b2fd07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f70 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609518:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f928700) 00010000:00010000:2.0:1788581292.609544:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581292.609575:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609592:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609603:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609616:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609624:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609630:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609732:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609740:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.609746:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581292.613103:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581292.613142:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613154:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613184:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613190:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.613195:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613203:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613222:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff995d4203b000) 00010000:00010000:2.0:1788581292.613225:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788581292.613230:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613237:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fdfc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613718:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613726:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613731:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613736:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581292.613739:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613756:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613766:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4203b500) 00010000:00010000:2.0:1788581292.613768:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581292.613771:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613777:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b2fdee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581292.613793:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1e4036b reply state 00000000be7c75f3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613807:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.613815:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995d4203b200) 00010000:00010000:2.0:1788581292.613817:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581292.613821:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581292.613954:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:10481:x1875463170449152:12345-192.168.203.3@tcp:36:rm.0 Request processed in 4745us (5076us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788581292.613963:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00010000:00010000:2.0:1788581292.738710:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581293.761489:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581293.807771:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581293.807810:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581293.807933:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449408 00000100:00100000:2.0:1788581293.807944:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449408 00000100:00100000:0.0:1788581293.808022:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581293.808099:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581293.808118:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581293.808135:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449920 00000100:00100000:2.0:1788581293.808139:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449920 00000100:00100000:2.0:1788581293.808188:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1788581293.808197:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170449408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581293.808371:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170449408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 174us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.808378:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1788581293.808396:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1788581293.808403:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170449920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581293.808427:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170449920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.808431:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00080000:2.0:1788581293.808456:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581293.808579:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449536 00000100:00100000:2.0:1788581293.808584:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449536 00000100:00100000:2.0:1788581293.808613:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1788581293.808619:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170449536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581293.808874:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170449536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 193us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.808884:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00080000:2.0:1788581293.808902:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581293.808966:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581293.809068:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449664 00000100:00100000:0.0:1788581293.809072:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449664 00000100:00100000:0.0:1788581293.809105:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:0.0:1788581293.809112:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170449664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581293.809147:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170449664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581293.809154:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1788581293.809247:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449792 00000100:00100000:2.0:1788581293.809344:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449792 00000100:00100000:2.0:1788581293.809381:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:2.0:1788581293.809390:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170449792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581293.809422:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170449792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 32us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.809428:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00080000:2.0:1788581293.809456:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581293.809557:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170449280 00000100:00100000:0.0:1788581293.809568:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170449280 00000100:00100000:0.0:1788581293.809633:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:0.0:1788581293.809642:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170449280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581293.809684:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170449280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 44us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581293.809700:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:1.0:1788581293.890837:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581293.890859:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184157312:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788581293.890886:0:9953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280032631129ns, next at 281032628851ns, rc = 0 00000100:00100000:1.0:1788581293.890939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581293.890990:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184157440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581293.891012:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581293.891043:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157312 00000100:00100000:1.0:1788581293.891049:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157312 00000100:00100000:1.0:1788581293.891096:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157440 00000100:00100000:1.0:1788581293.891099:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157440 00000100:00100000:1.0:1788581293.891115:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788581293.891124:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184157312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788581293.891151:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581293.891199:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184157312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581293.891205:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788581293.891220:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788581293.891226:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184157440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581293.891235:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581293.891278:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184157440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581293.891284:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788581293.891303:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788581293.891329:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7faa9180 x1875463184157440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581293.891347:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184157440:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788581293.891357:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432caa00 x1875463184157312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581293.891368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184157312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581293.891764:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184157696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.891798:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.891826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184158208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.891847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.891868:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184158720:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.891888:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.891910:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788581293.891916:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184157568:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.891942:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.891961:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184158080:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.891982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.892000:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184158592:0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.892020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581293.892045:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157696 00000100:00100000:2.0:1788581293.892049:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157696 00000100:00100000:2.0:1788581293.892077:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158208 00000100:00100000:2.0:1788581293.892081:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158208 00000100:00100000:2.0:1788581293.892102:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158720 00000100:00100000:2.0:1788581293.892105:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158720 00000100:00100000:2.0:1788581293.892120:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788581293.892125:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184157696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.892164:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184157696:12345-0@lo:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.892171:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788581293.892186:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788581293.892192:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184158208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.892232:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184158208:12345-0@lo:400:kworker.0 Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.892238:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788581293.892250:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788581293.892286:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184158720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.892315:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184158720:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.892321:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788581293.892344:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157568 00000100:00100000:2.0:1788581293.892348:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157568 00000100:00100000:2.0:1788581293.892371:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788581293.892377:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184157568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581293.892407:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184157568:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.892413:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788581293.892457:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158080 00000100:00100000:2.0:1788581293.892460:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158080 00000100:00100000:2.0:1788581293.892486:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788581293.892494:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184158080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892636:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184157824:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892664:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581293.892681:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184158336:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892700:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581293.892713:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184158848:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892730:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581293.892747:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788581293.892753:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184157952:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892782:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581293.892799:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184158464:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581293.892868:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158336 00000100:00100000:3.0:1788581293.892872:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158336 00000100:00100000:3.0:1788581293.892894:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158848 00000100:00100000:3.0:1788581293.892896:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158848 00000100:00100000:3.0:1788581293.892907:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157952 00000100:00100000:3.0:1788581293.892909:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157952 00000100:00100000:3.0:1788581293.892920:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788581293.892926:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184158336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.892962:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184158336:12345-0@lo:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581293.892968:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788581293.892983:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788581293.892989:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184158848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893017:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184158848:12345-0@lo:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581293.893023:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788581293.893034:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788581293.893040:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184157952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893066:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184157952:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581293.893072:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788581293.893118:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184157952:0@lo:400:kworker.0 00010000:00080000:3.0:1788581293.893132:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e477b4e00 x1875463184158336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581293.893151:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184158336:0@lo:400:kworker.0 00010000:00080000:3.0:1788581293.893164:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43364000 x1875463184158848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581293.893172:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184158848:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893199:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184157568:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893209:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184157696:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893217:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184158208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893225:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184158720:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893274:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184157824 00000100:00100000:3.0:1788581293.893278:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184157824 00000100:00100000:3.0:1788581293.893296:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788581293.893302:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184157824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893337:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184157824:12345-0@lo:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581293.893342:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788581293.893369:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184157824:0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893396:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158592 00000100:00100000:3.0:1788581293.893399:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158592 00000100:00100000:3.0:1788581293.893422:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158464 00000100:00100000:3.0:1788581293.893424:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158464 00000100:00100000:3.0:1788581293.893457:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581293.893464:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581293.893509:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184158592:12345-0@lo:400:kworker.0 Request processed in 46us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581293.893514:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788581293.893697:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184158080:12345-0@lo:400:kworker.0 Request processed in 1204us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581293.893704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788581293.895061:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581293.895076:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184158464:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788581293.895656:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581293.895663:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581293.895665:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581293.895836:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184158464:12345-0@lo:400:kworker.0 Request processed in 765us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581293.895844:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788581293.895871:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ed880 x1875463184158464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581293.895885:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184158464:0@lo:400:kworker.0 00000100:00100000:1.0:1788581293.895891:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184158080:0@lo:400:kworker.0 00010000:00080000:1.0:1788581293.895903:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ee680 x1875463184158592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581293.895911:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184158592:0@lo:400:kworker.0 00010000:00010000:0.0:1788581294.785708:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581294.916522:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184158976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581294.916611:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581294.916703:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184158976 00000100:00100000:3.0:1788581294.916711:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184158976 00000100:00100000:3.0:1788581294.916760:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788581294.916768:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184158976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581294.916797:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581294.923184:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184158976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6399us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581294.923199:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788581294.923407:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184158976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581295.813002:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581296.348712:0:13652:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788581296.833379:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581296.968748:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184159104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581296.969177:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.969279:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159104 00000100:00100000:1.0:1788581296.969287:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159104 00000100:00100000:1.0:1788581296.969336:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581296.969345:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184159104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581296.969374:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581296.969497:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184159104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.969505:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1788581296.969547:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43364700 x1875463184159104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581296.969565:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184159104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581296.969613:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581296.972930:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581296.972955:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581296.973026:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581296.974210:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159232 00000100:00100000:2.0:1788581296.974222:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159232 00000100:00100000:2.0:1788581296.974315:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788581296.974325:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184159232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581296.974350:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581296.974428:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184159232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581296.974436:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788581296.974653:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581296.974688:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13800 x1875463184159232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581296.974708:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184159232:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788581297.403175:0:13700:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff106f17e0 20000000:00000080:2.0:1788581297.403192:0:13700:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995d417ec000 uarg=0000000000000000 20000000:01000000:2.0:1788581297.403233:0:13700:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788581297.403239:0:13700:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788581297.403245:0:13700:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788581297.404045:0:13701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788581297.404491:0:13700:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788581297.410774:0:13700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788581297.410817:0:13700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788581297.410833:0:13700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788581297.410854:0:13700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581297.410874:0:13700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410893:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410901:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410924:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410931:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410938:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410945:0:13700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410953:0:13700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.410991:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.411008:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 23 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.411023:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159360:0@lo:104: 00000100:00100000:2.0:1788581297.411088:0:13700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581297.411161:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.411170:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 23 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.411180:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159488:0@lo:104: 00000100:00100000:0.0:1788581297.411641:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581297.411655:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159360 00000100:00100000:0.0:1788581297.411663:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159360 00000100:00100000:0.0:1788581297.411726:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581297.411736:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13700:x1875463184159360:12345-0@lo:104: 00010000:00010000:0.0:1788581297.411749:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.411819:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581297.411826:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13700:x1875463184159360:12345-0@lo:104: Request processed in 91us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581297.411833:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788581297.412185:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581297.412194:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412204:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e82161200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581297.412208:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412227:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581297.412236:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581297.412243:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581297.412309:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412316:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581297.412350:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581297.412356:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184159616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581297.412363:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e82161200/0x50f0cc74b7b2fcc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fccf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412380:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581297.412383:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581297.412385:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581297.412398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581297.412511:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159616 00000100:00100000:1.0:1788581297.412516:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159616 00010000:00010000:1.0:1788581297.412548:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 24 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.412578:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581297.412586:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184159616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581297.412597:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581297.412602:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 24 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412614:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 24 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.412631:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581297.412672:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184159616:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581297.412679:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581297.412790:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184159616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581297.413535:0:13700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581297.413580:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.413592:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 23 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.413614:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159744:0@lo:104: 00000100:00100000:2.0:1788581297.413640:0:13700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581297.413672:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.413681:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 23 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.413690:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159872:0@lo:104: 00000100:00100000:2.0:1788581297.413713:0:13700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581297.413733:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.413743:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 12 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.413752:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184160000:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581297.413794:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159488 00010000:00010000:2.0:1788581297.413804:0:13700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581297.413810:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159488 00010000:00010000:2.0:1788581297.413812:0:13700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 12 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581297.413834:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159744 00000100:00100000:2.0:1788581297.413834:0:13700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184160128:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581297.413836:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159744 00000100:00100000:3.0:1788581297.413851:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184159872 00000100:00100000:3.0:1788581297.413860:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184159872 00000100:00100000:3.0:1788581297.413877:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581297.413884:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:13700:x1875463184159488:12345-0@lo:104: 00010000:00010000:3.0:1788581297.413894:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.413943:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581297.413949:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+5:13700:x1875463184159488:12345-0@lo:104: Request processed in 66us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581297.413956:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581297.413971:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581297.413979:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:13700:x1875463184159744:12345-0@lo:104: 00010000:00010000:1.0:1788581297.413980:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581297.413988:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.413989:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.414007:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581297.414013:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.414023:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581297.414031:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581297.414048:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581297.414075:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.414082:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788581297.414090:0:13700:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788581297.414102:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.414111:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4000/0x50f0cc74b7b2fcba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcc1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.414114:0:13700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b2fccf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcc8 expref: 23 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.414130:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581297.414132:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159360:0@lo:104: 00010000:00010000:1.0:1788581297.414134:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581297.414138:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581297.414146:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159488:0@lo:104: 00000100:00100000:2.0:1788581297.414155:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159744:0@lo:104: 00010000:00010000:3.0:1788581297.414163:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581297.414168:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+4:13700:x1875463184159744:12345-0@lo:104: Request processed in 191us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581297.414173:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581297.414188:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788581297.414195:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13700:x1875463184159872:12345-0@lo:104: 00010000:00010000:3.0:1788581297.414203:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414274:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581297.414281:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+3:13700:x1875463184159872:12345-0@lo:104: Request processed in 86us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581297.414288:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788581297.414310:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581297.414314:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414320:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581297.414323:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414330:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581297.414335:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581297.414340:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581297.414353:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414358:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581297.414374:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414380:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5800/0x50f0cc74b7b2fcac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fcb3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414389:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581297.414392:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414397:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581297.414399:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414423:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581297.414429:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581297.414434:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581297.414449:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414454:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581297.414460:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414466:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b2fc9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b2fca5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581297.414478:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581297.414479:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581297.414481:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581297.414492:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184160384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581297.414521:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581297.414549:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581297.414555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184160512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581297.414576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581297.414791:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43365180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184159872:0@lo:104: 00000100:00100000:1.0:1788581297.415508:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184160256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581297.415546:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581297.415587:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581297.415944:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160384 00000100:00100000:2.0:1788581297.415951:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160384 00010000:00010000:2.0:1788581297.415977:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 23 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.416014:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160512 00000100:00100000:2.0:1788581297.416017:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160512 00010000:00010000:2.0:1788581297.416028:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 24 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.416037:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160256 00000100:00100000:2.0:1788581297.416039:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160256 00010000:00010000:2.0:1788581297.416047:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 25 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.416058:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581297.416064:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+25:3618:x1875463184160384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581297.416076:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581297.416088:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 25 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.416100:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 25 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.416108:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788581297.416119:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e82161800/0x50f0cc74b7b2fcb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcac expref: 25 pid: 6487 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.416123:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+25:3618:x1875463184160512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581297.416138:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581297.416139:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581297.416146:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 24 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.416159:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 24 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.416171:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b2fca5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fc9e expref: 24 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581297.416180:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184160384:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581297.416187:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1788581297.416203:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581297.416207:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581297.416214:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3621:x1875463184160256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581297.416223:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581297.416227:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 22 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.416238:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 22 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.416243:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3618:x1875463184160512:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1663us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581297.416269:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b400/0x50f0cc74b7b2fcc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b2fcba expref: 22 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.416289:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581297.416315:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3621:x1875463184160256:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581297.416321:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788581297.416362:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788581297.416481:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184160256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581297.417191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184160512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581297.417201:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184160384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581297.426976:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581297.427029:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581297.427119:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450048 00000100:00100000:0.0:1788581297.427128:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450048 00010000:00010000:0.0:1788581297.427165:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 13 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581297.427208:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450176 00000100:00100000:0.0:1788581297.427212:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450176 00010000:00010000:0.0:1788581297.427225:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 14 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581297.427250:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1788581297.427295:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dea27fd-4c26-4644-b718-43c4e0969f66+14:2395:x1875463170450048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581297.427310:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581297.427317:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 14 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427330:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 14 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427351:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581297.427402:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dea27fd-4c26-4644-b718-43c4e0969f66+14:2395:x1875463170450048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581297.427423:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1788581297.427441:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1788581297.427448:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170450176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581297.427457:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581297.427463:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 13 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427472:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 13 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427495:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427503:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427518:0:7444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427525:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427533:0:7444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427540:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427546:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581297.427550:0:7444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427558:0:7444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427566:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.427574:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581297.427593:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170450176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 145us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581297.427620:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00010000:00010000:0.0:1788581297.435204:0:13700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4a00/0x50f0cc74b7b2fc97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f62 expref: 12 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581297.445861:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184160000:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581297.445904:0:13700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b2fc90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21f5b expref: 11 pid: 6487 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581297.445921:0:13700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43364000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13700:1875463184160128:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581297.445955:0:13700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.445965:0:13700:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.445972:0:13700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581297.445978:0:13700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b2fe03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581297.473468:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184160640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581297.473549:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581297.473757:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160640 00000100:00100000:0.0:1788581297.473766:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160640 00000100:00100000:0.0:1788581297.473826:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788581297.473836:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184160640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581297.473870:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581297.473919:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184160640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581297.473941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788581297.474022:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184160640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581297.859978:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788581297.997970:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788581297.998009:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788581297.998017:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788581297.998050:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998061:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998069:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998076:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40030600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581297.998081:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998090:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998109:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff995e6f928000) 00010000:00010000:2.0:1788581297.998112:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581297.998117:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.998120:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184160768:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788581297.998128:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b2fd5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998148:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998155:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998168:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998174:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6aa00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581297.998177:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998184:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.998192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581297.998199:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff995e75629b00) 00010000:00010000:2.0:1788581297.998203:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581297.998206:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998213:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fd70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998232:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998239:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998245:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998250:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e82160800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581297.998275:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998295:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.998298:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160768 00010000:00010000:2.0:1788581297.998307:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff995e6f928000) 00000100:00100000:1.0:1788581297.998308:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160768 00010000:00010000:2.0:1788581297.998313:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581297.998317:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998323:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e82160800/0x50f0cc74b7b2fdd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998339:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998346:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998352:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998357:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581297.998360:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998366:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581297.998374:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff995d4203b200) 00010000:00010000:2.0:1788581297.998377:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581297.998379:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581297.998514:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581297.998524:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184160768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788581297.998550:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788581297.998579:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b95ac, atime: 0x6a9b95ac, ctime: 0x6a9b95ac, blocks: 0x0 00010000:00010000:1.0:1788581297.998587:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.998671:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1788581297.998677:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581297.998683:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.998701:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.998721:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.998729:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.998746:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788581297.999490:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184160768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 964us (1298us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788581297.999499:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788581297.999527:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788581297.999537:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581297.999544:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.999552:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581297.999556:0:10311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.999563:0:10311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.999577:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581297.999598:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b2fe0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.001122:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581298.001127:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581298.001129:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581298.002466:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fe00/0x50f0cc74b7b2fdf5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581298.003584:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e4f277100/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788581298.003598:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184160768:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1788581298.275194:0:13750:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea066a880 20000000:00000080:2.0:1788581298.275209:0:13750:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995d438a0800 uarg=0000000000000000 20000000:01000000:2.0:1788581298.276903:0:13750:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788581298.276912:0:13750:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788581298.276917:0:13750:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788581298.278865:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788581298.279090:0:13750:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788581298.279185:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788581298.279219:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788581298.279236:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788581298.279248:0:13750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581298.280465:0:13750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280484:0:13750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280494:0:13750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280501:0:13750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280507:0:13750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280513:0:13750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280537:0:13750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581298.280542:0:13750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280551:0:13750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280564:0:13750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280571:0:13750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.280577:0:13750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b2fe11 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581298.561437:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581298.561444:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f944800 from 7 10000000:01000000:3.0:1788581298.561448:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581298.561512:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.561525:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.561536:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581298.561562:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184160896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.561633:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.561708:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.561858:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184160896 00000100:00100000:0.0:1788581298.561867:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184160896 00000100:00100000:0.0:1788581298.561921:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788581298.561931:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:6490:x1875463184160896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581298.561944:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581298.561959:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b2fe1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fe18 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.561983:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b2fe1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe18 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.561999:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b2fe1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe18 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.562009:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71800, rc 0) 00000100:00100000:0.0:1788581298.562074:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184160896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.562081:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788581298.563430:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184160896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581298.563454:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.563466:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581298.563538:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.563580:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.563636:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581298.563695:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161024 00000100:00100000:2.0:1788581298.563701:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161024 00000100:00100000:2.0:1788581298.563750:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788581298.563758:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184161024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.563876:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184161024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.563882:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788581298.564007:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.564038:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.564076:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.564096:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.564161:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161152 00000100:00100000:0.0:1788581298.564165:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161152 00000100:00100000:0.0:1788581298.564197:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788581298.564205:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184161152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.564530:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184161152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.564537:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788581298.564613:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581298.565036:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13763:1875463184161280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581298.565075:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581298.565105:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.565250:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161280 00000100:00100000:3.0:1788581298.565276:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161280 00000100:00100000:3.0:1788581298.565309:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788581298.565316:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:13763:x1875463184161280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.565423:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:13763:x1875463184161280:12345-0@lo:502:llog_process_th.0 Request processed in 106us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.565429:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788581298.565605:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13763:1875463184161280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581298.565630:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581298.565639:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581298.565642:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581298.565649:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6f944800 00000020:00000080:1.0:1788581298.565652:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581298.565789:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581298.565794:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581298.565795:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581298.565798:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581298.565801:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581298.565803:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788581298.565806:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6f944800 00000020:00000080:1.0:1788581298.565808:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581298.565852:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13763:1875463184161408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581298.565888:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581298.565916:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.567057:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161408 00000100:00100000:3.0:1788581298.567066:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161408 00000100:00100000:3.0:1788581298.567110:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788581298.567118:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:13763:x1875463184161408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.567418:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:13763:x1875463184161408:12345-0@lo:502:llog_process_th.0 Request processed in 300us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.567426:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788581298.568933:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13763:1875463184161408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581298.568977:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581298.568985:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581298.568988:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788581298.568992:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788581298.569369:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788581298.569396:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581298.569416:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.569444:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581298.569453:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581298.569456:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6f8e1800 from 7 10000000:01000000:2.0:1788581298.569458:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581298.569489:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.569497:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.569506:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581298.569525:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.569575:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.569613:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581298.570652:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161536 00000100:00100000:1.0:1788581298.570661:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161536 00000100:00100000:1.0:1788581298.570838:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788581298.570849:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:6490:x1875463184161536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581298.570864:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581298.570879:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6be00/0x50f0cc74b7b2fe2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fe26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.570901:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6be00/0x50f0cc74b7b2fe2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe26 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.570913:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6be00/0x50f0cc74b7b2fe2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe26 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.570922:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6be00, rc 0) 00000100:00100000:1.0:1788581298.570988:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184161536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581298.570995:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788581298.571074:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581298.571090:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.571098:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581298.571188:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.571219:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.582881:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0b40 going to sleep for 11 seconds 00000040:00080000:3.0:1788581298.583550:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581298.584245:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161664 00000100:00100000:2.0:1788581298.584269:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161664 00000100:00100000:2.0:1788581298.584320:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788581298.584330:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184161664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.584491:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184161664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (13271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.584498:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788581298.584932:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.584982:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.585047:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.585086:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.585865:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161792 00000100:00100000:0.0:1788581298.585880:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161792 00000100:00100000:0.0:1788581298.585913:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788581298.585921:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184161792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.586013:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184161792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.586020:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788581298.587654:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184161792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.588795:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13767:1875463184161920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.588878:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.588923:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581298.588978:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184161920 00000100:00100000:2.0:1788581298.588985:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184161920 00000100:00100000:2.0:1788581298.589028:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788581298.589044:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:13767:x1875463184161920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581298.589171:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:13767:x1875463184161920:12345-0@lo:502:llog_process_th.0 Request processed in 127us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.589178:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788581298.589688:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13767:1875463184161920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581298.589793:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581298.589804:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.589806:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581298.589812:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6f8e1800 00000020:00000080:3.0:1788581298.589815:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581298.596864:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581298.596878:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.596880:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581298.596885:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581298.596890:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.596891:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788581298.596896:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6f8e1800 00000020:00000080:3.0:1788581298.596905:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788581298.600386:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13767:1875463184162048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.600481:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.600560:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581298.600986:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162048 00000100:00100000:2.0:1788581298.600995:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162048 00000100:00100000:2.0:1788581298.601045:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788581298.601055:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:13767:x1875463184162048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581298.605473:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:13767:x1875463184162048:12345-0@lo:502:llog_process_th.0 Request processed in 4413us (4986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.605488:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788581298.605594:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13767:1875463184162048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581298.605632:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581298.605641:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.605643:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788581298.605648:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788581298.605929:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788581298.605966:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581298.605976:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.605988:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581298.605998:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581298.606002:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4f1e6000 from 7 10000000:01000000:2.0:1788581298.606005:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581298.606035:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.606043:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.606052:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581298.606081:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.606118:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.606216:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162176 00000100:00100000:3.0:1788581298.606222:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162176 00000100:00100000:3.0:1788581298.606284:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788581298.606293:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:6490:x1875463184162176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581298.606305:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581298.606316:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2fe3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fe34 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.606339:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2fe3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe34 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.606348:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2fe3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe34 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.606355:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e429c2e00, rc 0) 00000100:00100000:3.0:1788581298.606385:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.606391:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788581298.606538:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581298.606552:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581298.606564:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.606573:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581298.606624:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.606648:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.606672:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.606781:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162304 00000100:00100000:3.0:1788581298.606792:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162304 00000100:00100000:3.0:1788581298.606823:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788581298.606832:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.607384:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 552us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.607392:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788581298.612460:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.612552:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.612643:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.612682:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.613054:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162432 00000100:00100000:3.0:1788581298.613072:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162432 00000100:00100000:3.0:1788581298.613169:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788581298.613179:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.613375:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.613382:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788581298.613596:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.614654:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13770:1875463184162560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581298.614729:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.614768:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.614815:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162560 00000100:00100000:3.0:1788581298.614822:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162560 00000100:00100000:3.0:1788581298.614939:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788581298.614949:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:13770:x1875463184162560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.615059:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:13770:x1875463184162560:12345-0@lo:502:llog_process_th.0 Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.615066:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788581298.615171:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13770:1875463184162560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581298.615196:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581298.615205:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581298.615207:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581298.615566:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4f1e6000 00000020:00000080:2.0:1788581298.615570:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581298.615633:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581298.615637:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581298.615639:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581298.615643:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581298.615646:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581298.615647:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788581298.615652:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4f1e6000 00000020:00000080:2.0:1788581298.615654:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788581298.615693:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13770:1875463184162688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581298.615731:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.615763:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.616732:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162688 00000100:00100000:3.0:1788581298.616760:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162688 00000100:00100000:3.0:1788581298.616804:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788581298.616813:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:13770:x1875463184162688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.616951:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:13770:x1875463184162688:12345-0@lo:502:llog_process_th.0 Request processed in 138us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.616969:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788581298.617105:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13770:1875463184162688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581298.617133:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581298.617152:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581298.617155:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788581298.617159:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788581298.617228:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788581298.617294:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581298.617305:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.617315:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581298.617326:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581298.617328:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3a800 from 7 10000000:01000000:0.0:1788581298.617330:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581298.617357:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.617366:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.617385:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581298.617412:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.617449:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581298.617476:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.617988:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162816 00000100:00100000:3.0:1788581298.617994:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162816 00000100:00100000:3.0:1788581298.618034:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788581298.618041:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:6490:x1875463184162816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581298.618053:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581298.618065:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e429c3600/0x50f0cc74b7b2fe49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b2fe42 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.618086:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e429c3600/0x50f0cc74b7b2fe49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe42 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.618096:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e429c3600/0x50f0cc74b7b2fe49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe42 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.618105:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e429c3600, rc 0) 00000100:00100000:3.0:1788581298.618146:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184162816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.618152:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788581298.618512:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581298.618526:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.618536:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581298.618595:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.618627:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581298.618657:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.618697:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184162944 00000100:00100000:3.0:1788581298.618701:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184162944 00000100:00100000:3.0:1788581298.618739:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788581298.618746:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184162944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.618959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184162944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.618966:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788581298.619025:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184162944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.619052:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184163072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581298.619093:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581298.619117:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581298.619212:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163072 00000100:00100000:3.0:1788581298.619223:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163072 00000100:00100000:3.0:1788581298.619388:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788581298.619395:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184163072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.619586:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:6490:x1875463184163072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.619592:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788581298.619654:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:6490:1875463184163072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788581298.622339:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788581298.623726:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13771:1875463184163200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.623930:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.623972:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44eeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.624020:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163200 00000100:00100000:0.0:1788581298.624028:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163200 00000100:00100000:0.0:1788581298.624976:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788581298.624989:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:13771:x1875463184163200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581298.625487:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:13771:x1875463184163200:12345-0@lo:502:llog_process_th.0 Request processed in 500us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.625496:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788581298.625619:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13771:1875463184163200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581298.625660:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581298.625670:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.625672:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581298.625679:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4eb3a800 00000020:00000080:3.0:1788581298.625681:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581298.625736:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581298.625739:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.625741:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581298.625743:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581298.625745:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.625747:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788581298.625823:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4eb3a800 00000020:00000080:3.0:1788581298.625826:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788581298.625931:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13771:1875463184163328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581298.625972:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.626007:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44eeec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581298.626541:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163328 00000100:00100000:2.0:1788581298.626549:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163328 00000100:00100000:2.0:1788581298.626594:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788581298.626603:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:13771:x1875463184163328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581298.626698:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:13771:x1875463184163328:12345-0@lo:502:llog_process_th.0 Request processed in 96us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.626705:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788581298.626795:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:13771:1875463184163328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581298.626819:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581298.626828:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581298.626829:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788581298.626833:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788581298.627048:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788581298.627071:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581298.627080:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.627091:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.882421:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581298.921116:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581298.921159:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581298.921186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581298.921217:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450688 00000100:00100000:0.0:1788581298.921233:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581298.921248:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450688 00000100:00100000:0.0:1788581298.921295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581298.921316:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581298.921333:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450304 00000100:00100000:0.0:1788581298.921337:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450304 00000100:00100000:0.0:1788581298.921380:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 352 00000100:00100000:0.0:1788581298.921390:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2394:x1875463170450304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581298.921439:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1788581298.921453:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581298.921475:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2394:x1875463170450304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581298.921492:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.921499:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 352 00000100:00100000:2.0:1788581298.921506:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1788581298.921672:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450432 00000100:00100000:1.0:1788581298.921677:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450432 00000100:00100000:1.0:1788581298.921718:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450944 00000100:00100000:1.0:1788581298.921722:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450944 00000100:00100000:1.0:1788581298.921732:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450560 00000100:00100000:1.0:1788581298.921734:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450560 00000100:00100000:1.0:1788581298.921742:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170450816 00000100:00100000:1.0:1788581298.921744:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170450816 00000100:00100000:1.0:1788581298.921756:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1788581298.921761:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581298.921816:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581298.921822:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1788581298.921834:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:1.0:1788581298.921841:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170450944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581298.921867:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1788581298.921868:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170450944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581298.921875:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:3.0:1788581298.921882:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581298.921890:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:1.0:1788581298.921899:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170450816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581298.921920:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170450560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 43us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581298.921931:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1788581298.921931:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170450816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581298.921942:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00080000:1.0:1788581298.921963:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581298.921967:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581298.921970:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581299.009499:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581299.009524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581299.009598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.009691:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163456 00000100:00100000:3.0:1788581299.009700:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163456 00000100:00100000:3.0:1788581299.009758:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581299.009768:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184163456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581299.009798:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581299.009858:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184163456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.009866:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788581299.009889:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581299.010129:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184163712:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.010169:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581299.010194:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.010211:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184163840:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.010218:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581299.010250:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184164736:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.010289:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581299.010302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.010321:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184164352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.010344:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184163584:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.010359:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581299.010435:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184163968:0@lo:400:kworker.0 00000100:00100000:0.0:1788581299.010686:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163712 00000100:00100000:0.0:1788581299.010692:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163712 00000100:00100000:0.0:1788581299.010732:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164224 00000100:00100000:0.0:1788581299.010735:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164224 00000100:00100000:0.0:1788581299.010753:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164736 00000100:00100000:0.0:1788581299.010755:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164736 00000100:00100000:0.0:1788581299.010767:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164352 00000100:00100000:0.0:1788581299.010769:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164352 00000100:00100000:0.0:1788581299.010781:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788581299.010798:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.011556:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184164864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.011556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.011955:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581299.011965:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184164096:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.011997:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.011998:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163840 00000100:00100000:3.0:1788581299.012005:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163840 00000100:00100000:1.0:1788581299.012028:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184164608:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.012101:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164096 00000100:00100000:3.0:1788581299.012105:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164096 00000100:00100000:3.0:1788581299.012138:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788581299.012144:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184163840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.012169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.012202:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184163840:12345-0@lo:400:kworker.0 Request processed in 57us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.012210:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788581299.012225:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581299.012230:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788581299.012239:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184164096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.012300:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184164096:12345-0@lo:400:kworker.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.012306:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788581299.012325:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163584 00000100:00100000:3.0:1788581299.012329:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163584 00000100:00100000:3.0:1788581299.012352:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788581299.012360:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184163584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.012365:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164608 00000100:00100000:1.0:1788581299.012379:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164608 00000100:00100000:3.0:1788581299.012424:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184163584:12345-0@lo:400:kworker.0 Request processed in 64us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581299.012428:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788581299.012436:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788581299.012440:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184164608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.012478:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184164608:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581299.012484:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788581299.012528:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581299.012547:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164864 00000100:00100000:3.0:1788581299.012551:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164864 00000100:00100000:3.0:1788581299.012572:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788581299.012579:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184164224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.012831:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184164224:12345-0@lo:400:kworker.0 Request processed in 252us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.012838:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788581299.012854:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788581299.012860:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184164736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.012901:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184164736:12345-0@lo:400:kworker.0 Request processed in 41us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.012908:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788581299.012923:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.012927:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788581299.012936:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184164352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.012953:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184163584:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.012967:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184164096:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.012975:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184164352:12345-0@lo:400:kworker.0 Request processed in 40us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.012986:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:1.0:1788581299.012997:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43360380 x1875463184164608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581299.013002:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788581299.013012:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184164864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.013111:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184164864:12345-0@lo:400:kworker.0 Request processed in 100us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.013117:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788581299.013131:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184164608:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.013157:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184163840:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.013171:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165120 00010000:00080000:3.0:1788581299.013176:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43361f80 x1875463184164352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581299.013177:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165120 00000100:00100000:3.0:1788581299.013189:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184164352:0@lo:400:kworker.0 00010000:00080000:3.0:1788581299.013204:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43360700 x1875463184164864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581299.013214:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581299.013217:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184164864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.013224:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184165120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581299.013238:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788581299.013310:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581299.013314:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581299.013317:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581299.013319:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581299.013360:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184164736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.013369:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184165120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.013376:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184164224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581299.013380:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581299.013443:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581299.014186:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184163712:12345-0@lo:400:kworker.0 Request processed in 3397us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581299.014201:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788581299.014319:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.014429:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e477b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184163712:0@lo:400:kworker.0 00000100:00100000:0.0:1788581299.014514:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184163968 00000100:00100000:0.0:1788581299.014522:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184163968 00000100:00100000:2.0:1788581299.014537:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184164480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581299.014562:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788581299.014572:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581299.014723:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581299.014793:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184164992:0@lo:400:kworker.0 00000100:00100000:2.0:1788581299.014820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581299.014908:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164480 00000100:00100000:3.0:1788581299.014913:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164480 00000100:00100000:3.0:1788581299.014981:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184164992 00000100:00100000:3.0:1788581299.014985:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184164992 00000100:00100000:3.0:1788581299.015003:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581299.015009:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184164480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.015050:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184164480:12345-0@lo:400:kworker.0 Request processed in 41us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.015057:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581299.015069:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788581299.015076:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184164992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.015102:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184164992:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.015108:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581299.015144:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184163968:12345-0@lo:400:kworker.0 Request processed in 571us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581299.015154:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788581299.015155:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184163968:0@lo:400:kworker.0 00010000:00080000:3.0:1788581299.015173:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43363480 x1875463184164480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581299.015182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184164480:0@lo:400:kworker.0 00000100:00100000:3.0:1788581299.015192:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184164992:0@lo:400:kworker.0 00000100:00080000:2.0:1788581299.015551:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581299.048508:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581299.050835:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451072 00000100:00100000:2.0:1788581299.050848:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451072 00000100:00100000:2.0:1788581299.050917:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 354 00000100:00100000:2.0:1788581299.050928:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:6163:x1875463170451072:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581299.050945:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581299.050964:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fe50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21faf expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.050994:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fe50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21faf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.051004:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fe50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21faf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.051029:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581299.051227:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451072:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 300us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581299.051234:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 354 00000100:00100000:0.0:1788581299.056365:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581299.061299:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451200 00000100:00100000:3.0:1788581299.061315:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451200 00000100:00100000:3.0:1788581299.061471:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 355 00000100:00100000:3.0:1788581299.061482:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451200:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581299.061642:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451200:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 161us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.061650:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 355 00000100:00100000:0.0:1788581299.070469:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581299.070560:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451328 00000100:00100000:2.0:1788581299.070570:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451328 00000100:00100000:2.0:1788581299.070625:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 356 00000100:00100000:2.0:1788581299.070636:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451328:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581299.070782:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451328:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581299.070790:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 356 00000100:00100000:1.0:1788581299.076234:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581299.076605:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451456 00000100:00100000:3.0:1788581299.076616:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451456 00000100:00100000:3.0:1788581299.076671:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 357 00000100:00100000:3.0:1788581299.076682:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:10766:x1875463170451456:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581299.076819:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:10766:x1875463170451456:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 138us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.076835:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 357 00000100:00100000:1.0:1788581299.097082:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581299.097188:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451584 00000100:00100000:0.0:1788581299.097197:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451584 00000100:00100000:0.0:1788581299.097292:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:0.0:1788581299.097303:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:10766:x1875463170451584:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581299.097456:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+12:10766:x1875463170451584:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581299.097463:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:0.0:1788581299.119235:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581299.119448:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451712 00000100:00100000:2.0:1788581299.119458:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451712 00000100:00100000:2.0:1788581299.119507:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:2.0:1788581299.119518:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:6163:x1875463170451712:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581299.119534:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581299.119551:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fe57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df21fb6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.119577:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fb6 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.119587:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fb6 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581299.119595:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00000100:00100000:2.0:1788581299.119658:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170451712:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 142us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581299.119665:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:1.0:1788581299.121822:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581299.121906:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451840 00000100:00100000:3.0:1788581299.121915:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451840 00000100:00100000:3.0:1788581299.121966:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:3.0:1788581299.121975:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170451840:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581299.122108:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170451840:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 133us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.122116:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:1.0:1788581299.124347:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581299.125991:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170451968 00000100:00100000:0.0:1788581299.126004:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170451968 00000100:00100000:0.0:1788581299.126071:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 361 00000100:00100000:0.0:1788581299.126081:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170451968:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581299.126228:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f11a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:6163:x1875463170451968:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 147us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581299.126246:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 361 00000100:00100000:0.0:1788581299.135854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581299.136048:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452096 00000100:00100000:2.0:1788581299.136058:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452096 00000100:00100000:2.0:1788581299.136113:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 362 00000100:00100000:2.0:1788581299.136123:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:10769:x1875463170452096:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581299.136310:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:10769:x1875463170452096:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 187us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581299.136318:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 362 00000100:00100000:1.0:1788581299.148312:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581299.148427:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452224 00000100:00100000:3.0:1788581299.148437:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452224 00000100:00100000:3.0:1788581299.148495:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 363 00000100:00100000:3.0:1788581299.148506:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:10769:x1875463170452224:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581299.148653:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:10769:x1875463170452224:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 149us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581299.148672:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 363 00000040:00080000:3.0:1788581299.590033:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788581299.650249:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581299.905607:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581300.033834:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581300.033860:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184165248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581300.033938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581300.034077:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165248 00000100:00100000:2.0:1788581300.034087:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165248 00000100:00100000:2.0:1788581300.034147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788581300.034157:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184165248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581300.034190:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581300.034248:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184165248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581300.034274:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788581300.034684:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184165248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581300.932644:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.954357:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581302.081579:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184165376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581302.081673:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581302.082312:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165376 00000100:00100000:3.0:1788581302.082322:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165376 00000100:00100000:3.0:1788581302.082399:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581302.082410:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184165376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581302.082441:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788581302.082560:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581302.082583:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184165504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581302.082616:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581302.082659:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165504 00000100:00100000:2.0:1788581302.082663:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165504 00000100:00100000:2.0:1788581302.082691:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788581302.082698:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184165504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581302.082721:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581302.082753:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184165504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581302.082761:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788581302.082778:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581302.082801:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad0e00 x1875463184165504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581302.082819:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184165504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581302.085883:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184165376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3466us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581302.085897:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788581302.087717:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad2a00 x1875463184165376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581302.087746:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184165376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581302.594880:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184165632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581302.594952:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581302.595132:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165632 00000100:00100000:3.0:1788581302.595142:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165632 00000100:00100000:3.0:1788581302.595200:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788581302.595211:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184165632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581302.595243:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581302.595325:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184165632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581302.595333:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788581302.595467:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184165632:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581302.977485:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788581303.619804:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1788581304.002175:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581304.045508:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581304.045612:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452480 00000100:00100000:3.0:1788581304.045621:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452480 00000100:00100000:3.0:1788581304.045692:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:3.0:1788581304.045704:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170452480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581304.045782:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170452480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.045806:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00080000:2.0:1788581304.045870:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581304.053689:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581304.053724:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581304.053751:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581304.053906:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452608 00000100:00100000:2.0:1788581304.053915:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452608 00000100:00100000:2.0:1788581304.053977:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452864 00000100:00100000:2.0:1788581304.053981:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452864 00000100:00100000:2.0:1788581304.054007:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1788581304.054016:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170452608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581304.054085:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170452608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.054092:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1788581304.054110:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:2.0:1788581304.054116:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170452864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581304.054140:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170452864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.054146:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:3.0:1788581304.054895:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452352 00000100:00100000:3.0:1788581304.054911:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452352 00000100:00100000:3.0:1788581304.054948:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 364 00000100:00100000:3.0:1788581304.054955:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170452352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581304.054988:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170452352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.054994:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 364 00000100:00100000:2.0:1788581304.055179:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581304.055325:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581304.055781:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452992 00000100:00100000:1.0:1788581304.055804:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452992 00000100:00100000:1.0:1788581304.055848:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:1.0:1788581304.055856:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170452992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581304.055896:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170452992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.055909:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00080000:0.0:1788581304.056127:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581304.056132:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581304.058051:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170452736 00000100:00100000:3.0:1788581304.058063:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170452736 00000100:00100000:3.0:1788581304.058203:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1788581304.058214:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170452736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581304.058324:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170452736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 112us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.058331:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00080000:0.0:1788581304.059437:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581304.129597:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581304.129621:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581304.129688:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.129759:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165760 00000100:00100000:1.0:1788581304.129767:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165760 00000100:00100000:1.0:1788581304.129819:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581304.129829:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184165760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581304.129858:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788581304.129883:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581304.129905:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184165760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.129924:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581304.129949:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581304.129974:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.130010:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788581304.130016:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e4f277100, transno 4294967301 00000100:00100000:1.0:1788581304.130030:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581304.130198:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184165888 00000100:00100000:2.0:1788581304.130205:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184165888 00000100:00100000:2.0:1788581304.130242:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788581304.130250:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184165888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581304.130284:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581304.130318:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184165888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.130324:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788581304.130456:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581304.130487:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581304.130508:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581304.130518:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184166272:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130557:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.130586:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184166400:0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.130606:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166272 00000100:00100000:0.0:1788581304.130612:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166272 00000100:00100000:1.0:1788581304.130614:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.130631:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184166912:0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.130646:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788581304.130656:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581304.130659:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130676:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788581304.130684:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184166784:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130717:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581304.130722:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184166272:12345-0@lo:400:kworker.0 Request processed in 57us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.130737:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184167296:0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.130739:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788581304.130766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581304.130773:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184166144:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130791:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184166272:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130815:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166912 00000100:00100000:1.0:1788581304.130819:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166912 00000100:00100000:0.0:1788581304.130824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.130856:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581304.130858:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130877:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184166912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.130884:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581304.130914:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184167168:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130926:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184166912:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.130933:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581304.130943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.130961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166400 00000100:00100000:0.0:1788581304.130962:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788581304.130967:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166400 00000100:00100000:0.0:1788581304.130972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184166016:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.130991:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166784 00000100:00100000:1.0:1788581304.130995:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166784 00000100:00100000:0.0:1788581304.131005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.131016:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167296 00000100:00100000:1.0:1788581304.131020:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167296 00000100:00100000:0.0:1788581304.131034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184166528:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.131038:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166144 00000100:00100000:1.0:1788581304.131041:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166144 00000100:00100000:1.0:1788581304.131051:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166656 00000100:00100000:1.0:1788581304.131055:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166656 00000100:00100000:1.0:1788581304.131069:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167168 00000100:00100000:1.0:1788581304.131072:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167168 00000100:00100000:0.0:1788581304.131079:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.131087:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788581304.131094:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184166400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.131099:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184167040:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.131135:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184166400:12345-0@lo:400:kworker.0 Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.131139:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581304.131144:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788581304.131160:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788581304.131168:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184166784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.131193:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788581304.131198:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184166784:12345-0@lo:400:kworker.0 Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.131205:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.131207:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788581304.131223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788581304.131231:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.131284:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184167296:12345-0@lo:400:kworker.0 Request processed in 53us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.131291:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788581304.131311:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184166144:12345-0@lo:400:kworker.0 Request processed in 80us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.131316:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788581304.131403:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166528 00000100:00100000:3.0:1788581304.131407:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166528 00000100:00100000:0.0:1788581304.131423:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184166656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581304.131440:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788581304.131449:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184166528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.131475:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184166656:12345-0@lo:400:kworker.0 Request processed in 56us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.131495:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184166528:12345-0@lo:400:kworker.0 Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.131507:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788581304.131524:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167040 00000100:00100000:3.0:1788581304.131527:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167040 00000100:00100000:3.0:1788581304.131550:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581304.131556:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184167040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581304.131584:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184167040:12345-0@lo:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.131596:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581304.133338:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788581304.135019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788581304.135045:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184167168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581304.135138:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184167168:12345-0@lo:400:kworker.0 Request processed in 106us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.135145:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788581304.135217:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184166016 00000100:00100000:2.0:1788581304.135225:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184166016 00000100:00100000:2.0:1788581304.135282:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788581304.135289:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184166016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581304.135324:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184166016:12345-0@lo:400:kworker.0 Request processed in 35us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.135330:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788581304.135415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184166016:0@lo:400:kworker.0 00000100:00100000:2.0:1788581304.135431:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184166528:0@lo:400:kworker.0 00010000:00080000:2.0:1788581304.135446:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43815c00 x1875463184167040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581304.135466:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581304.135472:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581304.135477:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581304.135482:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184167040:0@lo:400:kworker.0 00000100:00100000:2.0:1788581304.135502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184166144:0@lo:400:kworker.0 00010000:00080000:1.0:1788581304.135513:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43815180 x1875463184166784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581304.135519:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.135535:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184166784:0@lo:400:kworker.0 00000100:00100000:2.0:1788581304.135539:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184167168:0@lo:400:kworker.0 00010000:00080000:1.0:1788581304.135554:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facc380 x1875463184167296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581304.135566:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184167296:0@lo:400:kworker.0 00000100:00100000:1.0:1788581304.135582:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184166400:0@lo:400:kworker.0 00010000:00080000:1.0:1788581304.135596:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814a80 x1875463184166912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581304.135605:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184166912:0@lo:400:kworker.0 00000100:00100000:0.0:1788581304.139533:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:1.0:1788581305.026360:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581305.153505:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184167424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581305.153579:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581305.153741:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167424 00000100:00100000:3.0:1788581305.153749:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167424 00000100:00100000:3.0:1788581305.153808:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788581305.153817:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184167424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581305.153849:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581305.159039:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184167424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5213us (5449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581305.159054:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788581305.161678:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184167424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581306.049800:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581307.075652:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581307.201588:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581307.201611:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184167552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581307.201688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581307.201771:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167552 00000100:00100000:2.0:1788581307.201778:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167552 00000100:00100000:2.0:1788581307.201828:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788581307.201838:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184167552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581307.201867:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581307.201924:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184167552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.201930:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788581307.201986:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4700 x1875463184167552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581307.202159:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581307.202237:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184167552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581307.203027:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581307.203042:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184167680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581307.203105:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581307.203284:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167680 00000100:00100000:0.0:1788581307.203291:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167680 00000100:00100000:0.0:1788581307.203361:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581307.203370:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184167680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581307.203387:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581307.203438:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184167680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581307.203445:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788581307.203509:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581307.203632:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facce00 x1875463184167680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581307.203650:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184167680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581307.715495:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184167808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581307.715571:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581307.716215:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167808 00000100:00100000:3.0:1788581307.716224:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167808 00000100:00100000:3.0:1788581307.716300:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788581307.716310:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184167808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581307.716341:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788581307.716414:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184167808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.716421:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788581307.716726:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184167808:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581308.097724:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581309.121608:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581309.166042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166089:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166123:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166161:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166181:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166210:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581309.166236:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453248 00000100:00100000:1.0:1788581309.166245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453248 00000100:00100000:1.0:1788581309.166324:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453760 00000100:00100000:1.0:1788581309.166328:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453760 00000100:00100000:3.0:1788581309.166556:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453504 00000100:00100000:3.0:1788581309.166561:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453504 00000100:00100000:0.0:1788581309.166577:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453376 00000100:00100000:0.0:1788581309.166584:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453376 00000100:00100000:3.0:1788581309.166612:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:3.0:1788581309.166636:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581309.166661:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453632 00000100:00100000:1.0:1788581309.166665:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453632 00000100:00100000:3.0:1788581309.166707:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.166715:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1788581309.166742:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:3.0:1788581309.166753:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453120 00000100:00100000:3.0:1788581309.166758:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453120 00000100:00100000:2.0:1788581309.166764:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581309.166785:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 366 00000100:00100000:3.0:1788581309.166795:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170453120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581309.166811:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 50us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581309.166819:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:3.0:1788581309.166829:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170453120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.166837:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 366 00000100:00100000:2.0:1788581309.166842:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:2.0:1788581309.166852:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170453760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581309.166882:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170453760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581309.166889:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00080000:2.0:1788581309.166936:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581309.166942:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581309.166945:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581309.167922:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:0.0:1788581309.167936:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581309.168015:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170453376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 83us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581309.168022:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:3.0:1788581309.169271:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:3.0:1788581309.169284:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170453632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581309.169482:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170453632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 201us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.169489:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:1.0:1788581309.251937:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184167936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581309.252017:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581309.252097:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184167936 00000100:00100000:1.0:1788581309.252104:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184167936 00000100:00100000:1.0:1788581309.252153:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581309.252163:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184167936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581309.252189:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581309.252232:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184167936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581309.252239:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581309.252296:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184167936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581309.253114:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184168320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.253155:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581309.253178:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184168832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.253201:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581309.253218:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184169344:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.253237:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581309.253290:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581309.253299:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184168448:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.253331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.253389:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168320 00000100:00100000:2.0:1788581309.253390:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184168960:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.253402:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168320 00000100:00100000:2.0:1788581309.253426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.253478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788581309.253490:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184168320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.253581:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184168320:12345-0@lo:400:kworker.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.253589:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788581309.253605:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184168064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.253624:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168960 00000100:00100000:3.0:1788581309.253631:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168960 00000100:00100000:0.0:1788581309.253655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581309.253705:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184168576:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.253710:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581309.253730:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184168960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.253750:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581309.253787:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184169088:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.253797:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184168960:12345-0@lo:400:kworker.0 Request processed in 69us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.253807:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581309.253831:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.253834:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168576 00000100:00100000:3.0:1788581309.253840:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168576 00000100:00100000:0.0:1788581309.253864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184169600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581309.253875:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788581309.253885:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184168576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.253917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.253939:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184168576:12345-0@lo:400:kworker.0 Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.253947:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788581309.253974:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169088 00000100:00100000:3.0:1788581309.253980:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169088 00000100:00100000:0.0:1788581309.253989:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184168576:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.254012:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788581309.254015:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581309.254027:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184168192:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.254028:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184169088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.254087:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.254094:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184169088:12345-0@lo:400:kworker.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254102:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581309.254113:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184168704:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.254142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581309.254237:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184169216:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.254282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581309.254333:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168832 00000100:00100000:3.0:1788581309.254348:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168832 00010000:00080000:2.0:1788581309.254371:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7800 x1875463184168960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581309.254403:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184168960:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254409:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184169472:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254433:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581309.254473:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184168320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254509:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168064 00000100:00100000:2.0:1788581309.254514:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168064 00000100:00100000:3.0:1788581309.254518:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169344 00000100:00100000:3.0:1788581309.254525:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169344 00000100:00100000:3.0:1788581309.254557:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168448 00000100:00100000:3.0:1788581309.254562:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168448 00000100:00100000:2.0:1788581309.254573:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788581309.254584:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168192 00000100:00100000:2.0:1788581309.254588:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184168064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.254590:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168192 00000100:00100000:3.0:1788581309.254612:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184168704 00000100:00100000:3.0:1788581309.254617:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184168704 00000100:00100000:2.0:1788581309.254652:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184168064:12345-0@lo:400:kworker.0 Request processed in 68us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254660:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788581309.254666:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788581309.254672:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184168832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254713:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169600 00000100:00100000:2.0:1788581309.254720:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169600 00000100:00100000:3.0:1788581309.254744:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184168832:12345-0@lo:400:kworker.0 Request processed in 74us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254752:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788581309.254765:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788581309.254773:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788581309.254782:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184169600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581309.254790:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184169344:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788581309.254800:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581309.254842:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184169344:12345-0@lo:400:kworker.0 Request processed in 55us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254852:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788581309.254861:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184169600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254869:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788581309.254878:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788581309.254888:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184168448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254917:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788581309.254934:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184168192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.254943:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184168448:12345-0@lo:400:kworker.0 Request processed in 55us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581309.254953:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788581309.254974:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788581309.254985:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184168704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.254994:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184168192:12345-0@lo:400:kworker.0 Request processed in 65us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581309.255003:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788581309.255040:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184168704:12345-0@lo:400:kworker.0 Request processed in 56us (894us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581309.255044:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581309.255053:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581309.255057:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1788581309.255060:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581309.255065:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581309.255104:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169472 00000100:00100000:2.0:1788581309.255109:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169472 00000100:00100000:2.0:1788581309.255157:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788581309.255166:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184169472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.255209:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184169472:12345-0@lo:400:kworker.0 Request processed in 44us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581309.255214:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581309.256839:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184168448:0@lo:400:kworker.0 00000100:00100000:3.0:1788581309.256861:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184169472:0@lo:400:kworker.0 00010000:00080000:3.0:1788581309.256881:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4e00 x1875463184168832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581309.256920:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184168832:0@lo:400:kworker.0 00010000:00080000:3.0:1788581309.256936:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43815180 x1875463184169344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581309.256945:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184169344:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.269219:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184168064:0@lo:400:kworker.0 00010000:00080000:0.0:1788581309.269242:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814a80 x1875463184169088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581309.269268:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184169088:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.269313:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184169600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581309.269370:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184168192:0@lo:400:kworker.0 00000100:00100000:0.0:1788581309.269382:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184168704:0@lo:400:kworker.0 00000100:00100000:2.0:1788581309.269772:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169216 00000100:00100000:2.0:1788581309.269780:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169216 00000100:00100000:2.0:1788581309.269861:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788581309.269871:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184169216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788581309.270035:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581309.270174:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184169216:12345-0@lo:400:kworker.0 Request processed in 304us (15890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581309.270181:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788581309.280076:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184169216:0@lo:400:kworker.0 00000040:00080000:1.0:1788581309.826557:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788581309.891508:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581310.145649:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581310.275594:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184169728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581310.275677:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581310.275793:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169728 00000100:00100000:3.0:1788581310.275800:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169728 00000100:00100000:3.0:1788581310.275859:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788581310.275868:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184169728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581310.275908:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581310.276218:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184169728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 350us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581310.276225:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788581310.276336:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184169728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581311.169537:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581312.193528:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581312.321708:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581312.321730:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184169856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581312.321797:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.321920:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169856 00000100:00100000:0.0:1788581312.321928:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169856 00000100:00100000:0.0:1788581312.321996:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581312.322006:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184169856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581312.322037:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581312.322097:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184169856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581312.322105:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1788581312.322144:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7a642680 x1875463184169856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581312.322162:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184169856:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581312.322370:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581312.323120:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581312.323134:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184169984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581312.323177:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581312.323274:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184169984 00000100:00100000:2.0:1788581312.323280:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184169984 00000100:00100000:2.0:1788581312.323350:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788581312.323359:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184169984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581312.323375:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581312.323412:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184169984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581312.323418:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788581312.323653:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581312.323690:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fad5500 x1875463184169984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581312.323708:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184169984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581312.833663:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184170112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581312.833741:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.833906:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170112 00000100:00100000:0.0:1788581312.833915:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170112 00000100:00100000:0.0:1788581312.833963:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788581312.833973:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184170112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581312.834005:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581312.834066:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184170112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581312.834072:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788581312.834167:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184170112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581313.218156:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581314.241559:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581314.287886:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581314.287947:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581314.287975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581314.288022:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454144 00000100:00100000:0.0:1788581314.288032:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454144 00000100:00100000:0.0:1788581314.288081:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454016 00000100:00100000:0.0:1788581314.288084:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454016 00000100:00100000:0.0:1788581314.288107:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1788581314.288118:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454144:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581314.288200:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454144:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.288208:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1788581314.288224:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:0.0:1788581314.288231:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581314.288277:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581314.288497:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581314.288502:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581314.290049:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170453888 00000100:00100000:1.0:1788581314.290062:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170453888 00000100:00100000:1.0:1788581314.290117:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 368 00000100:00100000:1.0:1788581314.290139:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170453888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581314.290197:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170453888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 60us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.290204:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 368 00000100:00100000:0.0:1788581314.290894:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:2.0:1788581314.295492:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581314.295608:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581314.295662:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581314.295879:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454400 00000100:00100000:1.0:1788581314.295889:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454400 00000100:00100000:1.0:1788581314.295965:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454528 00000100:00100000:1.0:1788581314.295969:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454528 00000100:00100000:1.0:1788581314.295992:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:1.0:1788581314.296001:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170454400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581314.296084:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170454400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 83us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.296092:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:1.0:1788581314.296108:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:1.0:1788581314.296114:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170454528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581314.296169:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170454528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.296175:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00080000:2.0:1788581314.296464:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581314.296468:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581314.297397:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454272 00000100:00100000:3.0:1788581314.297406:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454272 00000100:00100000:3.0:1788581314.297473:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1788581314.297494:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2392:x1875463170454272:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581314.297521:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fd7e 00000100:00080000:3.0:1788581314.297529:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995e7faa2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581314.297586:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788581314.297740:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+2:2392:x1875463170454272:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 248us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581314.297747:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00010000:00010000:1.0:1788581314.297957:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581314.298408:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581314.369597:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184170368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581314.369698:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581314.370469:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170368 00000100:00100000:1.0:1788581314.370481:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170368 00000100:00100000:1.0:1788581314.370564:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581314.370581:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184170368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581314.370617:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581314.370630:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581314.370652:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184170240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581314.370914:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184170752:0@lo:400:kworker.0 00000100:00080000:3.0:1788581314.370989:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581314.371006:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184170880:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.374945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.375060:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184170624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.375121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.375165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184171136:0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.375171:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184170368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4585us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.375189:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788581314.375198:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581314.375234:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170240 00000100:00100000:0.0:1788581314.375243:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184171648:0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.375244:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170240 00000100:00100000:0.0:1788581314.375561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581314.377288:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581314.377771:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581314.377783:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184170240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788581314.377811:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581314.377862:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170624 00000100:00100000:0.0:1788581314.377877:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170624 00000100:00100000:1.0:1788581314.377886:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184170240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.377895:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788581314.377933:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581314.377935:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171136 00000100:00100000:0.0:1788581314.377940:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171136 00000100:00100000:1.0:1788581314.377961:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184170496:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.377984:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171648 00000100:00100000:0.0:1788581314.377989:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171648 00000100:00100000:1.0:1788581314.378009:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.378020:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788581314.378034:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184170624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.378056:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184171008:0@lo:400:kworker.0 00000100:00100000:2.0:1788581314.378103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184171264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.378123:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184170624:12345-0@lo:400:kworker.0 Request processed in 90us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.378133:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788581314.378164:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788581314.378165:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.378179:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184171136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581314.378196:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184171776:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.378232:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184171136:12345-0@lo:400:kworker.0 Request processed in 56us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.378248:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788581314.378287:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581314.378300:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581314.378338:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170496 00000100:00100000:1.0:1788581314.378340:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184171520:0@lo:400:kworker.0 00000100:00100000:2.0:1788581314.378346:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170496 00000100:00100000:2.0:1788581314.378386:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788581314.378392:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581314.378399:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.378441:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171520 00000100:00100000:1.0:1788581314.378446:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171520 00000100:00100000:2.0:1788581314.378451:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184170496:12345-0@lo:400:kworker.0 Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581314.378460:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788581314.378493:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170752 00000100:00100000:2.0:1788581314.378497:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170752 00000100:00100000:2.0:1788581314.378519:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171008 00000100:00100000:2.0:1788581314.378521:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171008 00000100:00100000:0.0:1788581314.378547:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171264 00000100:00100000:0.0:1788581314.378554:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171264 00000100:00100000:0.0:1788581314.378579:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171776 00000100:00100000:0.0:1788581314.378581:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171776 00000100:00100000:0.0:1788581314.378596:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788581314.378603:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184171648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.378647:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184171648:12345-0@lo:400:kworker.0 Request processed in 44us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.378653:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788581314.378668:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581314.378674:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788581314.378681:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184171264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.378779:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184171520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.378824:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184171264:12345-0@lo:400:kworker.0 Request processed in 139us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.378836:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788581314.378843:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184171520:12345-0@lo:400:kworker.0 Request processed in 67us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.378857:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581314.378865:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788581314.378876:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184171776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.378930:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184171776:12345-0@lo:400:kworker.0 Request processed in 56us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.378938:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:0.0:1788581314.378976:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581314.378983:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581314.378988:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581314.379016:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788581314.379026:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184170752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.379080:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184170752:12345-0@lo:400:kworker.0 Request processed in 56us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.379087:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788581314.379151:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184170624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.379166:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184171136:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.379177:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184171648:0@lo:400:kworker.0 00000100:00100000:0.0:1788581314.379205:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184170240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581314.379349:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184170496:0@lo:400:kworker.0 00010000:00080000:1.0:1788581314.379366:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4a80 x1875463184171520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581314.379377:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184171520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.379442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184170752:0@lo:400:kworker.0 00010000:00080000:1.0:1788581314.379455:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e5880 x1875463184171264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581314.379463:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184171264:0@lo:400:kworker.0 00010000:00080000:1.0:1788581314.379473:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7800 x1875463184171776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581314.379777:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184171776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.380190:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581314.380225:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184171392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.380268:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581314.380295:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171392 00000100:00100000:3.0:1788581314.380311:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171392 00000100:00100000:3.0:1788581314.380364:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788581314.380371:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184171392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.380412:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184171392:12345-0@lo:400:kworker.0 Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581314.380420:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788581314.380459:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4e00 x1875463184171392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581314.380472:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184171392:0@lo:400:kworker.0 00000100:00080000:0.0:1788581314.380482:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581314.380483:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184171904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.380524:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581314.381364:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788581314.381377:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581314.381445:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184171008:12345-0@lo:400:kworker.0 Request processed in 72us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581314.381452:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788581314.381501:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184171008:0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.381782:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184170368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581314.381874:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184170880 00000100:00100000:1.0:1788581314.381880:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184170880 00000100:00100000:1.0:1788581314.381914:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788581314.382102:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184170880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581314.382161:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184170880:12345-0@lo:400:kworker.0 Request processed in 240us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581314.382168:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788581314.382762:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184171904 00000100:00100000:2.0:1788581314.382769:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184171904 00000100:00100000:2.0:1788581314.382813:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581314.382821:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184171904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581314.382862:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184171904:12345-0@lo:400:kworker.0 Request processed in 42us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581314.382868:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788581314.383153:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184170880:0@lo:400:kworker.0 00000100:00100000:3.0:1788581314.383165:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184171904:0@lo:400:kworker.0 00010000:00010000:1.0:1788581315.265630:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581315.394310:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184172032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581315.394414:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581315.394844:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172032 00000100:00100000:1.0:1788581315.394855:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172032 00000100:00100000:1.0:1788581315.394923:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788581315.394934:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184172032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581315.394989:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581315.395066:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184172032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581315.395073:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788581315.395348:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184172032:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581316.289522:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581317.313883:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581317.441664:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184172160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581317.441735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581317.441863:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172160 00000100:00100000:0.0:1788581317.441872:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172160 00000100:00100000:0.0:1788581317.441947:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788581317.441958:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184172160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581317.441998:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581317.442044:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184172160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581317.442051:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788581317.442169:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581317.442198:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facd180 x1875463184172160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581317.442215:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184172160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581317.443280:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581317.443314:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184172288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581317.443406:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581317.443577:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172288 00000100:00100000:2.0:1788581317.443587:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172288 00000100:00100000:2.0:1788581317.443667:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581317.443678:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184172288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581317.443706:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581317.443761:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184172288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.443769:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788581317.443836:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581317.443870:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e43279c00 x1875463184172288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581317.443893:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184172288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581317.955800:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581317.955832:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184172416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581317.955935:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581317.956333:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172416 00000100:00100000:0.0:1788581317.956345:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172416 00000100:00100000:0.0:1788581317.956413:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788581317.956425:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184172416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581317.956476:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788581317.956543:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184172416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581317.956550:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788581317.957133:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184172416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581318.338774:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581319.043322:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788581319.107676:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581319.366299:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581319.407863:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581319.407998:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581319.408037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581319.408109:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454656 00000100:00100000:1.0:1788581319.408123:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454656 00000100:00100000:1.0:1788581319.408195:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 370 00000100:00100000:1.0:1788581319.408207:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170454656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581319.408338:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170454656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581319.408347:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 370 00000100:00100000:2.0:1788581319.410361:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581319.410475:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454784 00000100:00100000:3.0:1788581319.410486:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454784 00000100:00100000:3.0:1788581319.410555:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170454912 00000100:00100000:3.0:1788581319.410559:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170454912 00000100:00100000:3.0:1788581319.410583:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:3.0:1788581319.410595:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581319.410700:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170454784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 108us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.410725:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:3.0:1788581319.410744:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:3.0:1788581319.410749:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170454912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581319.410777:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170454912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.410784:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00080000:3.0:1788581319.410805:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581319.410810:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581319.416610:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455168 00000100:00100000:1.0:1788581319.416630:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455168 00000100:00100000:2.0:1788581319.416657:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00080000:0.0:1788581319.422566:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581319.426181:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455040 00000100:00100000:2.0:1788581319.426203:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455040 00000100:00080000:2.0:1788581319.426384:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581319.426459:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:2.0:1788581319.426473:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170455168:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581319.426586:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170455168:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 117us (16237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581319.426594:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:2.0:1788581319.426619:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:2.0:1788581319.426626:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581319.426652:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (10004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581319.426658:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:3.0:1788581319.489474:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581319.489505:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184172544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581319.489600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.489748:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172544 00000100:00100000:0.0:1788581319.489759:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172544 00000100:00100000:0.0:1788581319.489839:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581319.489852:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184172544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581319.489889:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581319.489949:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184172544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.489957:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581319.490013:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184172544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788581319.492372:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581319.501474:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184172672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581319.501572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581319.501644:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581319.501654:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184172800:0@lo:400:kworker.0 00000100:00100000:3.0:1788581319.501687:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581319.501748:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172800 00000100:00100000:3.0:1788581319.501758:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172800 00000100:00100000:3.0:1788581319.501814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788581319.501826:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581319.501889:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184172800:12345-0@lo:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.501897:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788581319.501946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184172800:0@lo:400:kworker.0 00000100:00100000:3.0:1788581319.502011:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172672 00000100:00100000:3.0:1788581319.502015:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172672 00000100:00100000:3.0:1788581319.502054:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581319.502060:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184172672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581319.502080:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581319.502117:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184172672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.502124:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788581319.502308:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581319.506835:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184172672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581319.510795:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184172928:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.510915:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511015:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511050:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511094:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173056 00000100:00100000:0.0:1788581319.511105:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173056 00000100:00100000:0.0:1788581319.511165:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788581319.511176:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511246:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184173056:12345-0@lo:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.511300:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788581319.511356:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511404:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184173184:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511463:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184172928 00000100:00100000:0.0:1788581319.511467:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184172928 00000100:00100000:0.0:1788581319.511497:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173184 00000100:00100000:0.0:1788581319.511501:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173184 00000100:00100000:0.0:1788581319.511523:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788581319.511530:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184172928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511570:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184172928:12345-0@lo:400:kworker.0 Request processed in 41us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.511577:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788581319.511589:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788581319.511597:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511628:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184173184:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.511647:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788581319.511681:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184172928:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511703:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184173184:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511728:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581319.511735:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184173312:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511797:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184173440:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511855:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184173568:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511875:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.511897:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173440 00000100:00100000:0.0:1788581319.511901:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173440 00000100:00100000:0.0:1788581319.511929:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173568 00000100:00100000:0.0:1788581319.511931:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173568 00000100:00100000:0.0:1788581319.511945:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788581319.511951:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184173440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.511984:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184173440:12345-0@lo:400:kworker.0 Request processed in 32us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.511991:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788581319.512002:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788581319.512008:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184173568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512041:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184173568:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.512048:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:0.0:1788581319.512088:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facf100 x1875463184173568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581319.512099:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184173568:0@lo:400:kworker.0 00000100:00080000:0.0:1788581319.512117:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581319.512121:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581319.512136:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184173440:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512168:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184173696:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512196:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.512227:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173696 00000100:00100000:0.0:1788581319.512232:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173696 00000100:00100000:0.0:1788581319.512306:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581319.512313:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512351:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184173696:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.512358:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788581319.512376:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581319.512391:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7b80 x1875463184173696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581319.512401:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184173696:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512431:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581319.512438:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184173824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.512489:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173824 00000100:00100000:0.0:1788581319.512493:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173824 00000100:00100000:0.0:1788581319.512527:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581319.512533:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184173824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512577:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184173824:12345-0@lo:400:kworker.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.512584:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788581319.512598:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581319.512614:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7b80 x1875463184173824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581319.512624:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184173824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512656:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184173952:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512681:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.512705:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173952 00000100:00100000:0.0:1788581319.512709:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173952 00000100:00100000:0.0:1788581319.512734:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788581319.512740:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184173952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512774:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184173952:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.512780:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1788581319.512794:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581319.512810:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184173952:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512841:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512865:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581319.512891:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174080 00000100:00100000:0.0:1788581319.512894:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174080 00000100:00100000:0.0:1788581319.512920:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788581319.512926:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184174080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.512958:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184174080:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.512973:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:0.0:1788581319.513000:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e7b80 x1875463184174080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581319.513010:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184174080:0@lo:400:kworker.0 00000100:00080000:0.0:1788581319.513023:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581319.513078:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184173312 00000100:00100000:0.0:1788581319.513082:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184173312 00000100:00100000:0.0:1788581319.513107:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788581319.513114:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581319.513153:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184173312:12345-0@lo:400:kworker.0 Request processed in 40us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.513159:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788581319.513190:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184173312:0@lo:400:kworker.0 00000001:00100000:3.0:1788581320.010599:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581320.010613:0:9486:0:(genops.c:885:class_export_put()) final put ffff995d42e98800/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:1.0:1788581320.010767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42e98800/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-OST0001 00000020:00000080:1.0:1788581320.010833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7faa2000 for lustre-OST0001 00010000:00010000:3.0:1788581320.386075:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581320.514529:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184174208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581320.514637:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581320.515112:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174208 00000100:00100000:0.0:1788581320.515123:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174208 00000100:00100000:0.0:1788581320.515192:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788581320.515205:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184174208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581320.515302:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581320.515368:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184174208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.515377:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788581320.515537:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184174208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788581321.410906:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581322.433993:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581322.568003:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184174336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581322.568079:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581322.568366:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184174464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581322.568405:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581322.568466:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174336 00000100:00100000:0.0:1788581322.568482:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174336 00000100:00100000:2.0:1788581322.568508:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174464 00000100:00100000:2.0:1788581322.568514:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174464 00000100:00100000:0.0:1788581322.568541:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788581322.568549:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581322.568554:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184174336:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581322.568563:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184174464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581322.568585:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788581322.568585:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788581322.568838:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581322.569050:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184174464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 491us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581322.569058:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788581322.569185:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e43279180 x1875463184174464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581322.569204:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184174464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581322.579410:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184174336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10850us (11321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581322.579424:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788581322.579429:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d423e4380 x1875463184174336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581322.579458:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184174336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581323.074805:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581323.074827:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184174592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581323.074893:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581323.076122:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174592 00000100:00100000:2.0:1788581323.076134:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174592 00000100:00100000:2.0:1788581323.076191:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788581323.076201:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184174592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581323.076243:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788581323.076342:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184174592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581323.076349:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788581323.076586:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184174592:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788581323.457414:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581324.481870:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581324.532986:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581324.533037:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581324.533063:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581324.533080:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581324.533103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581324.533130:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455552 00000100:00100000:1.0:1788581324.533138:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455552 00000100:00100000:1.0:1788581324.533190:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455808 00000100:00100000:1.0:1788581324.533193:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455808 00000100:00100000:1.0:1788581324.533206:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455424 00000100:00100000:1.0:1788581324.533208:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455424 00000100:00100000:1.0:1788581324.533221:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455680 00000100:00100000:1.0:1788581324.533224:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455680 00000100:00100000:2.0:1788581324.533404:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455296 00000100:00100000:2.0:1788581324.533409:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455296 00000100:00100000:2.0:1788581324.533441:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 372 00000100:00100000:2.0:1788581324.533450:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170455296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581324.533514:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170455296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581324.533522:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 372 00000100:00100000:1.0:1788581324.534027:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:1.0:1788581324.534040:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170455552:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581324.534082:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170455552:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.534090:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:1.0:1788581324.534109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:1.0:1788581324.534116:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455808:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581324.534141:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455808:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.534158:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:1.0:1788581324.534172:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:1.0:1788581324.534178:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170455424:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581324.534207:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170455424:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.534213:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:1.0:1788581324.534226:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1788581324.534232:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455680:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581324.535942:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170455680:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1702us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.535953:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00080000:1.0:1788581324.535992:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581324.535998:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581324.609414:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581324.609434:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184174720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581324.609502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.609562:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174720 00000100:00100000:3.0:1788581324.609570:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174720 00000100:00100000:3.0:1788581324.609621:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788581324.609631:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184174720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581324.609666:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581324.609710:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184174720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581324.609717:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788581324.609737:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581324.609771:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184174720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581324.610199:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184174976:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610230:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610389:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184175488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610413:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610434:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184176000:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610455:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610477:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788581324.610483:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184175104:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610525:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184175616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610544:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610561:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184176128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.610582:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581324.610611:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174976 00000100:00100000:3.0:1788581324.610615:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174976 00000100:00100000:3.0:1788581324.610639:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175488 00000100:00100000:3.0:1788581324.610642:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175488 00000100:00100000:3.0:1788581324.610662:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176000 00000100:00100000:3.0:1788581324.610665:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176000 00000100:00100000:3.0:1788581324.610676:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175616 00000100:00100000:3.0:1788581324.610685:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175616 00000100:00100000:3.0:1788581324.610701:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176128 00000100:00100000:3.0:1788581324.610704:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176128 00000100:00100000:3.0:1788581324.610718:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788581324.610724:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184174976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.610857:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184175232:0@lo:400:kworker.0 00000100:00100000:1.0:1788581324.611158:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175104 00000100:00100000:1.0:1788581324.611162:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175104 00000100:00100000:1.0:1788581324.611188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788581324.611194:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184175104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.611291:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184174848:0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.611344:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184174976:12345-0@lo:400:kworker.0 Request processed in 620us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581324.611352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788581324.611373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788581324.611379:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184175488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.611599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581324.611614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184175744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.611637:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581324.611655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184176256:0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.611677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581324.611706:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175744 00000100:00100000:0.0:1788581324.611710:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175744 00000100:00100000:0.0:1788581324.611735:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176256 00000100:00100000:0.0:1788581324.611738:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176256 00000100:00100000:0.0:1788581324.611758:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581324.611856:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.611896:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184175744:12345-0@lo:400:kworker.0 Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.611902:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581324.611916:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788581324.611926:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.611955:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184176256:12345-0@lo:400:kworker.0 Request processed in 33us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.611972:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788581324.612014:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e10a80 x1875463184175744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581324.612027:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184175744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612038:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184176256:0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612088:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175232 00000100:00100000:0.0:1788581324.612091:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175232 00000100:00100000:0.0:1788581324.612111:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788581324.612118:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184176000:12345-0@lo:400:kworker.0 Request processed in 35us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.612158:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788581324.612172:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788581324.612177:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612223:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184175616:12345-0@lo:400:kworker.0 Request processed in 45us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.612229:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788581324.612347:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788581324.612357:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612389:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184176128:12345-0@lo:400:kworker.0 Request processed in 35us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.612395:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788581324.612407:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788581324.612412:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184175232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.612453:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184175232:12345-0@lo:400:kworker.0 Request processed in 40us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.612459:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788581324.612488:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184175232:0@lo:400:kworker.0 00000100:00080000:0.0:1788581324.612536:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581324.612540:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581324.612543:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581324.612545:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581324.615546:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184175104:12345-0@lo:400:kworker.0 Request processed in 4343us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.615560:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788581324.622126:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581324.622712:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184175104:0@lo:400:kworker.0 00010000:00080000:1.0:1788581324.622732:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13480 x1875463184175616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581324.622743:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184175616:0@lo:400:kworker.0 00010000:00080000:1.0:1788581324.622779:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43394380 x1875463184176128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581324.622790:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184176128:0@lo:400:kworker.0 00000100:00100000:1.0:1788581324.622803:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184174976:0@lo:400:kworker.0 00000100:00100000:1.0:1788581324.622813:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184176000:0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.625055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184175360:0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.625131:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581324.625205:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184175872:0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.627115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581324.627170:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175872 00000100:00100000:2.0:1788581324.627179:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175872 00000100:00100000:3.0:1788581324.627476:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184174848 00000100:00100000:3.0:1788581324.627482:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184174848 00000100:00100000:3.0:1788581324.627518:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788581324.627527:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581324.627582:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184174848:12345-0@lo:400:kworker.0 Request processed in 56us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581324.627589:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788581324.627644:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184175488:12345-0@lo:400:kworker.0 Request processed in 16265us (17229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581324.627652:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788581324.629400:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788581324.629426:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184175872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.629648:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184175872:12345-0@lo:400:kworker.0 Request processed in 236us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581324.629656:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788581324.629689:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581324.629730:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e71e13100 x1875463184175872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581324.629744:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e71e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184175872:0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.629756:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184176384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581324.629919:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184175488:0@lo:400:kworker.0 00000100:00100000:1.0:1788581324.629995:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184175360 00000100:00100000:1.0:1788581324.630002:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184175360 00000100:00100000:1.0:1788581324.630048:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788581324.630055:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184175360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581324.630096:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184175360:12345-0@lo:400:kworker.0 Request processed in 41us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581324.630102:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788581324.631041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581324.631100:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184174848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581324.631112:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184175360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581324.631179:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176384 00000100:00100000:0.0:1788581324.631183:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176384 00000100:00100000:0.0:1788581324.631508:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581324.631517:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184176384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581324.631536:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581324.631578:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184176384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581324.631585:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581324.631664:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184176384:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788581324.693479:0:14028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:08:43 (1788581323) 00010000:00010000:0.0:1788581325.505466:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581325.634038:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581325.634063:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184176512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581325.634133:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581325.634638:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176512 00000100:00100000:2.0:1788581325.634647:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176512 00000100:00100000:2.0:1788581325.634701:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581325.634711:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184176512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581325.634744:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788581325.634817:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184176512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581325.634824:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788581325.634915:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184176512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788581326.529423:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581326.649958:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581326.650105:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170455936 00000100:00100000:0.0:1788581326.650114:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170455936 00000100:00100000:0.0:1788581326.650190:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:0.0:1788581326.650201:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:11059:x1875463170455936:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581326.650219:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581326.650251:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b2fe5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fbd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650380:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650393:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650406:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581326.650464:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581326.650467:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581326.650504:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650753:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b2fe5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fbd expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650772:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fbd expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.650781:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4233c400) 00010000:00010000:0.0:1788581326.650784:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581326.650787:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70800, rc 0) 00000100:00100000:0.0:1788581326.650854:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:11059:x1875463170455936:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 654us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581326.650861:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00080000:2.0:1788581326.651213:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581326.655876:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581326.655957:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456064 00000100:00100000:0.0:1788581326.655967:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456064 00000100:00100000:0.0:1788581326.656045:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1788581326.656056:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:11060:x1875463170456064:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581326.656076:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581326.656096:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b2fe6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fc4 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656171:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656185:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656197:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656212:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656218:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656234:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656317:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656325:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656331:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581326.656381:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581326.656385:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581326.656403:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656414:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656420:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656426:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656431:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581326.656435:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656453:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656465:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4233c400) 00010000:00010000:0.0:1788581326.656468:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581326.656473:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656478:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b2fe73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656490:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656506:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656789:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656794:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581326.656798:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656804:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656813:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff995d4233cb00) 00010000:00010000:0.0:1788581326.656816:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581326.656819:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656825:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b2fe7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656854:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b2fe6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fc4 expref: 8 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656865:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fc4 expref: 7 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581326.656872:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4233c000) 00010000:00010000:0.0:1788581326.656874:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581326.656883:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71000, rc 0) 00000100:00100000:0.0:1788581326.656939:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11060:x1875463170456064:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 886us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581326.656947:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1788581326.676619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581326.676944:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456192 00000100:00100000:1.0:1788581326.676955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456192 00000100:00100000:1.0:1788581326.677014:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581326.677024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11060:x1875463170456192:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788581326.677115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11060:x1875463170456192:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 92us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581326.677124:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1788581326.690767:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581326.691034:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456448 00000100:00100000:3.0:1788581326.691047:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456448 00000100:00100000:3.0:1788581326.691132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581326.691145:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11060:x1875463170456448:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581326.691172:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581326.691199:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fe88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fcb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.691351:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.691368:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.691382:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692045:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692069:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692081:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692244:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980000/0x50f0cc74b7b2fe9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692296:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980000/0x50f0cc74b7b2fe9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692312:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980000/0x50f0cc74b7b2fe9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581326.692323:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788581326.692641:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692651:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692659:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692664:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c2c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581326.692667:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692674:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692749:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4233c000) 00010000:00010000:3.0:1788581326.692754:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581326.692759:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692765:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c2c00/0x50f0cc74b7b2fe8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692780:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692785:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692797:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692802:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c3e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581326.692805:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692811:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692819:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff995e6f928a00) 00010000:00010000:3.0:1788581326.692822:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581326.692825:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.692831:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3e00/0x50f0cc74b7b2fe96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.693131:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e429c3a00/0x50f0cc74b7b2fe88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fcb expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.693147:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980000/0x50f0cc74b7b2fe9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fcb expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581326.693154:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:3.0:1788581326.693157:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581326.693159:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980000, rc 0) 00000100:00100000:3.0:1788581326.693244:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11060:x1875463170456448:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2101us (2491us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788581326.693309:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581326.700916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581326.701037:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456576 00000100:00100000:1.0:1788581326.701047:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456576 00000100:00100000:1.0:1788581326.701114:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1788581326.701125:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11060:x1875463170456576:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788581326.701293:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11060:x1875463170456576:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 170us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581326.701308:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1788581326.708392:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581326.708498:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456704 00000100:00100000:0.0:1788581326.708506:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456704 00000100:00100000:0.0:1788581326.708582:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00080000:2.0:1788581326.708782:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581326.708815:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:11060:x1875463170456704:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788581326.711507:0:11562:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2647us 00000100:00100000:1.0:1788581326.755810:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:11060:x1875463170456704:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 47202us (47409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581326.755834:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000040:00080000:1.0:1788581327.235247:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788581327.309563:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581327.553781:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581327.681906:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581327.681940:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184176640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581327.682043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581327.683556:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176640 00000100:00100000:3.0:1788581327.683575:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176640 00000100:00100000:3.0:1788581327.683759:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788581327.683774:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184176640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581327.683825:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788581327.683892:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581327.683946:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184176640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581327.683955:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788581327.683972:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7facf100 x1875463184176640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581327.684001:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184176640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581327.684145:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184176768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581327.684190:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581327.684744:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176768 00000100:00100000:3.0:1788581327.684752:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176768 00000100:00100000:3.0:1788581327.684804:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788581327.684812:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184176768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581327.684829:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788581327.686295:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581327.689077:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184176768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4252us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581327.689096:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1788581327.689616:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4391b480 x1875463184176768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581327.692204:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184176768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581328.193621:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581328.193650:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184176896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581328.193739:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581328.193852:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184176896 00000100:00100000:2.0:1788581328.193862:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184176896 00000100:00100000:2.0:1788581328.193927:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788581328.193938:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184176896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581328.193981:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788581328.194041:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184176896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581328.194049:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788581328.194679:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4391b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184176896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581328.577723:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581328.881075:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581328.881129:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170456832 00000100:00100000:3.0:1788581328.881139:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170456832 00000100:00100000:3.0:1788581328.881224:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1788581328.881234:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11102:x1875463170456832:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581328.881266:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581328.881287:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2feab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fd2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881359:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881372:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881386:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881400:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881407:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881413:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881451:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881459:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881465:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881471:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581328.881475:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881491:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881503:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4233c400) 00010000:00010000:3.0:1788581328.881506:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581328.881511:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881517:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b2feb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881530:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881536:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881541:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881546:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581328.881549:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881555:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881562:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff995e6f928400) 00010000:00010000:3.0:1788581328.881564:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581328.881567:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881581:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b2feb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881978:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2feab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fd2 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.881991:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4233c400) 00010000:00010000:3.0:1788581328.881993:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581328.881997:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2feab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fd2 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581328.882007:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581328.882088:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11102:x1875463170456832:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 855us (6516us total) trans 0 rc 301/301 00000100:00100000:3.0:1788581328.882096:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00080000:3.0:1788581328.882123:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581328.898710:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581328.898839:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457088 00000100:00100000:2.0:1788581328.898849:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457088 00000100:00100000:2.0:1788581328.898905:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1788581328.898915:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11102:x1875463170457088:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1788581328.898981:0:9504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581328.899007:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b2fe65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fbd expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899024:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d4233c400) 00010000:00010000:2.0:1788581328.899046:0:9504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581328.899107:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899120:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899129:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899139:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899145:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899151:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899725:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899737:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899745:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581328.899760:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080582ba3 reply state 0000000069b8397e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899771:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899789:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581328.899791:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581328.899794:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788581328.899799:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788581328.899807:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899814:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899819:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899825:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581328.899829:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899837:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899846:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995d42038b00) 00010000:00010000:2.0:1788581328.899848:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581328.899851:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899857:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fec0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581328.899870:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080582ba3 reply state 0000000069b8397e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899891:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581328.899896:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff995d42038a00) 00010000:00010000:2.0:1788581328.899898:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581328.899900:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788581328.899994:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:11102:x1875463170457088:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 1079us (1292us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788581328.900002:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1788581329.029347:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.029720:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457216 00000100:00100000:1.0:1788581329.029754:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457216 00000100:00100000:1.0:1788581329.029812:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1788581329.029823:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:11110:x1875463170457216:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:1.0:1788581329.029847:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581329.029871:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2fed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fd9 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.029937:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.029950:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.029961:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581329.030017:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581329.030021:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581329.030058:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.030082:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2fed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fd9 expref: 12 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.030102:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fd9 expref: 11 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.030112:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:1.0:1788581329.030115:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581329.030119:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6aa00, rc 0) 00000100:00100000:1.0:1788581329.030195:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:11110:x1875463170457216:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 373us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.030202:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1788581329.116906:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.117011:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457344 00000100:00100000:1.0:1788581329.117022:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457344 00000100:00100000:1.0:1788581329.117135:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:1.0:1788581329.117146:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:11116:x1875463170457344:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581329.117166:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581329.117186:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2fee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fe0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117310:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117324:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117336:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117347:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117353:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117359:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117457:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117484:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117492:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581329.117526:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788581329.117529:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581329.117562:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117571:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117575:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117580:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117583:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.117586:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117590:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117598:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:1.0:1788581329.117600:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.117603:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117614:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2feea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117626:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117631:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117637:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117642:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.117645:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117650:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117659:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff995d42038a00) 00010000:00010000:1.0:1788581329.117661:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.117664:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117670:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2fef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117698:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2fee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe0 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117711:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe0 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.117725:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581329.117727:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788581329.117730:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ae00, rc 0) 00000100:00100000:1.0:1788581329.117790:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11116:x1875463170457344:12345-192.168.203.3@tcp:101:bash.0 Request processed in 645us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.117797:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1788581329.126357:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.126453:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457600 00000100:00100000:1.0:1788581329.126462:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457600 00000100:00100000:1.0:1788581329.126519:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:1.0:1788581329.126528:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11116:x1875463170457600:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581329.126548:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581329.126566:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2feff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fe7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.126660:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.126674:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.126684:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.127907:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.127922:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.127946:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581329.129839:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788581329.131177:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.131198:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.131221:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132132:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132144:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132151:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132156:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.132161:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132167:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132180:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581329.132182:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.132201:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132219:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581329.132238:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dc01c9e reply state 00000000478acf63 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132248:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132358:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:1.0:1788581329.132361:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581329.132364:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788581329.132424:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2feff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132441:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.132582:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:1.0:1788581329.132584:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581329.132587:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:1.0:1788581329.132676:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11116:x1875463170457600:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6147us (6325us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788581329.133530:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1788581329.139551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.140043:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457728 00000100:00100000:0.0:1788581329.140055:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457728 00000100:00100000:0.0:1788581329.140109:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1788581329.140122:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170457728:12345-192.168.203.3@tcp:8:bash.0 00010000:00080000:0.0:1788581329.140153:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1788581329.140182:0:8410:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b2ff22 00002000:00100000:0.0:1788581329.140193:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36c1c238-f3ab-41d9-b90e-c3af2be29807/ffff995e7fb22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581329.140221:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788581329.140635:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788581329.140667:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e7fb22800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581329.140776:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170457728:12345-192.168.203.3@tcp:8:bash.0 Request processed in 653us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.140784:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581329.143903:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.144133:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457856 00000100:00100000:2.0:1788581329.144142:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457856 00000100:00100000:2.0:1788581329.144226:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1788581329.144237:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170457856:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581329.144627:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581329.144651:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21fee expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581329.144678:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581329.144698:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1788581329.144703:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581329.144713:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.144732:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 7 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788581329.145241:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788581329.146151:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:2.0:1788581329.146238:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:0:x1875463170457856:12345-192.168.203.3@tcp:101:bash.0 Request processed in 2000us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.146246:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1788581329.153378:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.153793:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170457984 00000100:00100000:0.0:1788581329.153803:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170457984 00000100:00100000:0.0:1788581329.153868:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1788581329.153894:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11116:x1875463170457984:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581329.153911:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581329.153932:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21ff5 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.153963:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.153973:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581329.153978:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581329.153983:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.154034:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.154461:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.154476:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184177024:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581329.154588:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581329.159860:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.159989:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184177024:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581329.160034:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.160685:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581329.160757:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:11116:x1875463170457984:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6862us (7386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.160765:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1788581329.163279:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170458112 00000100:00100000:1.0:1788581329.163379:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170458112 00010000:00010000:1.0:1788581329.163493:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581329.164148:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1788581329.164162:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170458112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581329.164179:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581329.164202:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.164227:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.164585:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9059076/0x50f0cc74b7b2ff29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fee expref: 8 pid: 8409 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.164606:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581329.164610:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581329.164618:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.164751:0:7444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.164871:0:7444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581329.164886:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7444:1875463184177152:192.168.203.3@tcp:105: 00000100:00100000:2.0:1788581329.165028:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581329.172572:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7444:1875463184177152:192.168.203.3@tcp:105: 00010000:00010000:0.0:1788581329.172597:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581329.172675:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170458112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 8516us (12823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.172687:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1788581329.177355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.177482:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170458368 00000100:00100000:1.0:1788581329.177493:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170458368 00000100:00100000:1.0:1788581329.177553:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1788581329.177565:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11116:x1875463170458368:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:1.0:1788581329.177878:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11116:x1875463170458368:12345-192.168.203.3@tcp:35:bash.0 Request processed in 314us (532us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788581329.177885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1788581329.269576:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581329.269669:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170458624 00000100:00100000:3.0:1788581329.269680:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170458624 00000100:00100000:3.0:1788581329.269748:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1788581329.269761:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11126:x1875463170458624:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581329.269785:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581329.269818:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df21ffc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581329.269920:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788581329.270016:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ffc expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581329.270030:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581329.270033:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581329.270039:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ffc expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581329.270052:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581329.270121:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11126:x1875463170458624:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 363us (565us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788581329.270128:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1788581329.275980:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.279028:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170458880 00000100:00100000:1.0:1788581329.279043:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170458880 00000100:00100000:2.0:1788581329.279283:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1788581329.279305:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11126:x1875463170458880:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581329.279553:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11126:x1875463170458880:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 251us (3583us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788581329.279562:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000040:00080000:2.0:1788581329.282314:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788581329.346197:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788581329.403786:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.405158:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459008 00000100:00100000:1.0:1788581329.405172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459008 00000100:00100000:1.0:1788581329.405291:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1788581329.405302:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11132:x1875463170459008:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581329.405325:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581329.405346:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22003 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405410:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405424:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405435:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581329.405476:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788581329.405480:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581329.405500:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405527:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ff45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22003 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405563:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22003 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.405572:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581329.405575:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581329.405579:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581329.405646:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11132:x1875463170459008:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 346us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.405653:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1788581329.413240:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.413388:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459264 00000100:00100000:0.0:1788581329.413399:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459264 00000100:00100000:0.0:1788581329.413458:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1788581329.413468:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11132:x1875463170459264:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581329.413489:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581329.413509:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b2ff53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2200a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.413617:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b2ff5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.413631:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b2ff5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.413642:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b2ff5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581329.413669:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788581329.413774:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b2ff53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2200a expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.413792:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b2ff5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2200a expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.413800:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:0.0:1788581329.413802:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581329.413806:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71e00, rc 0) 00000100:00100000:0.0:1788581329.413867:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11132:x1875463170459264:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 400us (635us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788581329.413874:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1788581329.416920:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581329.416967:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.417197:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459520 00000100:00100000:0.0:1788581329.417215:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459520 00000100:00100000:0.0:1788581329.417308:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1788581329.417319:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11132:x1875463170459520:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581329.417342:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581329.417362:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2ff68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22011 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.417459:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.417473:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.417500:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581329.417514:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788581329.417607:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b2ff68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22011 expref: 24 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.417623:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22011 expref: 23 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.417631:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:0.0:1788581329.417634:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788581329.417637:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70200, rc 0) 00000100:00100000:0.0:1788581329.417698:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:11132:x1875463170459520:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 380us (730us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788581329.417705:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1788581329.419081:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459648 00000100:00100000:2.0:1788581329.419091:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459648 00000100:00100000:2.0:1788581329.419169:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1788581329.419178:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2395:x1875463170459648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581329.419191:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581329.419233:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b2ff5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2200a expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.419250:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:2.0:1788581329.419288:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581329.419334:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2395:x1875463170459648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 157us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.419341:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1788581329.424199:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.425010:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459776 00000100:00100000:0.0:1788581329.425023:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459776 00000100:00100000:0.0:1788581329.425095:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1788581329.425105:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170459776:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1788581329.425163:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.425184:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.425193:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581329.425222:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581329.425227:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.425292:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.425307:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 7 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.425326:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184177280:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581329.425690:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581329.435544:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.435651:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170459904 00000100:00100000:1.0:1788581329.435660:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170459904 00002000:00100000:1.0:1788581329.435702:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff995d432caa00 x1875463170459904/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:685/0 lens 504/0 e 0 to 0 dl 1788581340 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581329.435714:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d432caa00 with x1875463170459904 ext(0->12) 00010000:00010000:1.0:1788581329.435723:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 8 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.435740:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 8 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581329.435747:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d432caa00 00000100:00100000:1.0:1788581329.435781:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1788581329.435790:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170459904:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:2.0:1788581329.436905:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7facce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184177280:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581329.436933:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788581329.438450:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000100:00100000:1.0:1788581329.439819:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170459904:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 4022us (4277us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788581329.439845:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:1.0:1788581329.439858:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff995d432caa00 x1875463170459904/t4294967300(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:685/0 lens 504/448 e 0 to 0 dl 1788581340 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581329.439869:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d432caa00 with x1875463170459904 ext(0->12) 00010000:00010000:1.0:1788581329.439879:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.439897:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581329.439908:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d432caa00 00000100:00100000:3.0:1788581329.448960:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.449048:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170460032 00000100:00100000:0.0:1788581329.449057:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170460032 00010000:00010000:0.0:1788581329.449096:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.449140:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1788581329.449151:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170460032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581329.449166:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788581329.449196:0:6478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788581329.449199:0:6478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788581329 00002000:00010000:0.0:1788581329.449202:0:6478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788581329 00002000:00010000:0.0:1788581329.449215:0:6478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788581329 00002000:00010000:0.0:1788581329.449218:0:6478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788581329.449225:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.449276:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.449301:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817bf946/0x50f0cc74b7b2ff30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df21ff5 expref: 9 pid: 8906 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.449315:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581329.449319:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581329.449324:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.449333:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.449357:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581329.449456:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449465:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449485:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449494:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449502:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449520:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581329.449525:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449534:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449546:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.449553:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc5dae83/0x50f0cc74b7b2ff7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.450397:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170460032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1234us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.450413:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1788581329.450831:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170459776:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 25726us (26639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.450840:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1788581329.461076:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.461142:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170460288 00000100:00100000:2.0:1788581329.461152:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170460288 00000100:00100000:2.0:1788581329.461226:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581329.461237:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11132:x1875463170460288:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1788581329.461338:0:6497:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22011 expref: 22 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581329.461585:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788581329.461635:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788581329.464052:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788581329.464117:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.464138:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.464146:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.466498:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.466523:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 26 pid: 6494 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581329.466540:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184177408:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581329.466670:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581329.476994:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7faab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184177408:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581329.477028:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581329.477158:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.477300:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170460416 00000100:00100000:2.0:1788581329.477308:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170460416 00010000:00010000:2.0:1788581329.477342:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 27 pid: 6494 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581329.477380:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1788581329.477399:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:2396:x1875463170460416:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581329.477434:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581329.477442:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 27 pid: 6494 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477453:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 27 pid: 6494 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477483:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ff14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe7 expref: 27 pid: 6494 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477498:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:2.0:1788581329.477503:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477513:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477520:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581329.477548:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581329.477592:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:2396:x1875463170460416:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 203us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.477600:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00010000:00010000:3.0:1788581329.477602:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581329.477612:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581329.477737:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788581329.477865:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788581329.477949:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ee300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184177536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788581329.477996:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581329.478033:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581329.478105:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184177536 00000100:00100000:1.0:1788581329.478112:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184177536 00000100:00100000:1.0:1788581329.478161:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788581329.478178:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184177536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788581329.478299:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184177536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.478305:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1788581329.478382:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581329.478742:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ee300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184177536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788581329.478906:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788581329.478959:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184177664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788581329.478995:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581329.479026:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581329.479139:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184177664 00000100:00100000:3.0:1788581329.479146:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184177664 00000100:00100000:3.0:1788581329.479190:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788581329.479199:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184177664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788581329.479346:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875463184177664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (349us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788581329.479353:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788581329.479567:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4225ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184177664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788581329.479615:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788581329.479716:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479726:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479733:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479739:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581329.479798:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479808:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479823:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:0.0:1788581329.479826:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788581329.479830:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.479835:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2ff84 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581329.479927:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788581329.479990:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788581329.480002:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315621747431ns, next at 316621745553ns, rc = 0 00000001:00080000:0.0:1788581329.480009:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788581329.480033:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:0.0:1788581329.480036:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788581329.480048:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ff6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22011 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.480149:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:11132:x1875463170460288:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 18914us (19082us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788581329.480158:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000020:00080000:0.0:1788581329.480162:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788581329.482640:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.482799:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170460544 00000100:00100000:0.0:1788581329.482809:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170460544 00000100:00100000:0.0:1788581329.482867:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1788581329.482876:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:11132:x1875463170460544:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581329.482899:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581329.482921:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b2ff8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22018 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.482976:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b2ff8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22018 expref: 30 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.482990:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b2ff8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22018 expref: 30 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.483006:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581329.483009:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581329.483013:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581329.483066:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11132:x1875463170460544:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 190us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.483180:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1788581329.493028:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.493554:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170460800 00000100:00100000:0.0:1788581329.493638:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170460800 00000100:00100000:0.0:1788581329.493698:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1788581329.493709:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11132:x1875463170460800:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581329.493978:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+31:11132:x1875463170460800:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 269us (957us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788581329.493986:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00010000:00010000:3.0:1788581329.601526:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581329.606501:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581329.606589:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461056 00000100:00100000:3.0:1788581329.606599:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461056 00000100:00100000:3.0:1788581329.606665:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1788581329.606675:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+31:11142:x1875463170461056:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581329.606700:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581329.606720:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2201f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581329.606810:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788581329.606897:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2201f expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581329.606929:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581329.606932:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581329.606938:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b2ff92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2201f expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581329.606951:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581329.607008:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11142:x1875463170461056:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 334us (515us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788581329.607016:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1788581329.615452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.615655:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461184 00000100:00100000:1.0:1788581329.615665:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461184 00000100:00100000:1.0:1788581329.615791:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581329.615813:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11142:x1875463170461184:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:1.0:1788581329.615889:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.615923:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.615936:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.615948:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.615956:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.615963:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616032:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616041:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616048:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581329.616093:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616105:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616111:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616128:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.616134:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.617387:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617401:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617417:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581329.617420:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.617424:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617430:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617447:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617453:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617458:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617463:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.617466:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617487:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617506:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:1.0:1788581329.617509:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.617513:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617519:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617531:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617537:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617543:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617548:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.617552:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617558:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617645:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581329.617648:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.617651:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.617668:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b2ffae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581329.617761:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11142:x1875463170461184:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 1958us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.617771:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581329.623657:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581329.623725:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461440 00000100:00100000:3.0:1788581329.623735:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461440 00000100:00100000:3.0:1788581329.624245:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581329.624646:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11142:x1875463170461440:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581329.624875:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:11142:x1875463170461440:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 619us (1225us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788581329.624883:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1788581329.647025:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.647065:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.647098:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.647129:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581329.647172:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461824 00000100:00100000:2.0:1788581329.647179:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461824 00000100:00100000:2.0:1788581329.647239:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461696 00000100:00100000:2.0:1788581329.647243:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461696 00000100:00100000:1.0:1788581329.647286:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461952 00000100:00100000:1.0:1788581329.647292:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461952 00000100:00100000:2.0:1788581329.647314:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1788581329.647326:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170461824:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581329.647404:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170461824:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581329.648514:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170461568 00000100:00100000:3.0:1788581329.648521:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170461568 00000100:00100000:3.0:1788581329.648554:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 374 00000100:00100000:3.0:1788581329.648560:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170461568:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581329.648597:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2394:x1875463170461568:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 37us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581329.648604:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 374 00000100:00080000:3.0:1788581329.648800:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581329.648806:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581329.650375:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:1.0:1788581329.650396:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170461696:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581329.650688:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2394:x1875463170461696:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 300us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.650696:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:1.0:1788581329.650717:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:1.0:1788581329.650724:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170461952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581329.650752:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2394:x1875463170461952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (3622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.650757:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:2.0:1788581329.652840:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1788581329.722952:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581329.723175:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170462208 00000100:00100000:1.0:1788581329.723184:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170462208 00000100:00100000:1.0:1788581329.723596:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581329.723608:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:11145:x1875463170462208:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581329.723633:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581329.723654:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22026 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723752:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723766:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723776:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723786:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723793:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723799:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723894:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723902:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.723910:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581329.723919:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788581329.723991:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724008:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724014:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724020:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.724025:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724032:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724045:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581329.724048:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.724052:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724058:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b2ffbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724070:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724075:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724080:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724084:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581329.724093:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724099:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724106:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:1.0:1788581329.724109:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581329.724111:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724117:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b2ffc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724153:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b2ffb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 36 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724165:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 35 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581329.724173:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581329.724175:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581329.724178:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581329.725090:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11145:x1875463170462208:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1480us (2141us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788581329.725099:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581329.728423:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581329.728488:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170462336 00000100:00100000:0.0:1788581329.728497:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170462336 00000100:00100000:0.0:1788581329.728551:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1788581329.728562:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11145:x1875463170462336:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581329.728629:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581329.729580:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581329.729598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184177792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581329.729711:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581329.729936:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.729948:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.729983:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.729990:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.729997:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.730002:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581329.730006:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.730025:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.730037:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581329.730040:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581329.730044:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581329.730050:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581329.730116:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11145:x1875463170462336:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 1554us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.730124:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1788581329.732886:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184177792 00000100:00100000:3.0:1788581329.732901:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184177792 00000100:00100000:3.0:1788581329.732967:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788581329.732978:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184177792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581329.733326:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184177920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581329.733388:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.733451:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184177920 00000100:00100000:2.0:1788581329.733455:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184177920 00000100:00080000:1.0:1788581329.733462:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581329.733485:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581329.733492:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184177920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581329.733508:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581329.733560:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184177920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.733567:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788581329.733801:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184177920:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581329.733971:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581329.734021:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184177792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1045us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581329.734028:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581329.734136:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581329.737917:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170462592 00000100:00100000:3.0:1788581329.737931:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170462592 00000100:00100000:3.0:1788581329.737991:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1788581329.738000:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11145:x1875463170462592:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581329.738222:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:11145:x1875463170462592:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 222us (4087us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788581329.738230:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1788581329.738750:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184177792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581329.739734:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581329.739793:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581329.739809:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184178176:0@lo:400:kworker.0 00000100:00100000:1.0:1788581329.739874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581329.740156:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178176 00000100:00100000:3.0:1788581329.740164:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178176 00000100:00100000:3.0:1788581329.740223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788581329.740233:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581329.740307:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184178176:12345-0@lo:400:kworker.0 Request processed in 76us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581329.740315:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788581329.740348:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184178176:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.741688:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184178048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.741832:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581329.742073:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.742078:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184178304:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.742104:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581329.742126:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184178816:0@lo:400:kworker.0 00000100:00100000:1.0:1788581329.742129:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178304 00000100:00100000:1.0:1788581329.742135:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178304 00000100:00100000:1.0:1788581329.742168:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788581329.742176:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184178304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.742343:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d431dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184178688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581329.742412:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178048 00000100:00100000:3.0:1788581329.742424:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178048 00000100:00100000:3.0:1788581329.742455:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788581329.742462:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581329.743796:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184178304:12345-0@lo:400:kworker.0 Request processed in 1614us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581329.743808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788581329.743890:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.744040:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184178432:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744087:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.744114:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184179072:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744144:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178560 00000100:00100000:2.0:1788581329.744150:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178560 00000100:00100000:2.0:1788581329.744178:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581329.744181:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184178304:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581329.744289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581329.744306:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184179200:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744328:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.744329:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184178560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744366:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.744379:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184178560:12345-0@lo:400:kworker.0 Request processed in 194us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.744381:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184178944:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744386:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788581329.744413:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178816 00000100:00100000:2.0:1788581329.744418:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178816 00000100:00100000:2.0:1788581329.744442:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184179072 00000100:00100000:2.0:1788581329.744445:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184179072 00000100:00100000:2.0:1788581329.744613:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178688 00000100:00100000:2.0:1788581329.744617:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178688 00000100:00100000:2.0:1788581329.744628:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184179200 00000100:00100000:2.0:1788581329.744630:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184179200 00000100:00100000:2.0:1788581329.744640:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178432 00000100:00100000:2.0:1788581329.744643:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178432 00000100:00100000:2.0:1788581329.744655:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788581329.744661:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744677:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581329.744696:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184178816:12345-0@lo:400:kworker.0 Request processed in 36us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.744702:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788581329.744720:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00010000:00080000:0.0:1788581329.744721:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7b131880 x1875463184178816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581329.744726:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744733:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184178816:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744756:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744773:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184178944 00000100:00100000:0.0:1788581329.744776:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184178944 00000100:00100000:0.0:1788581329.744803:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788581329.744809:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184178944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744828:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184179072:12345-0@lo:400:kworker.0 Request processed in 102us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.744835:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788581329.744838:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184178944:12345-0@lo:400:kworker.0 Request processed in 30us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.744843:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788581329.744846:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788581329.744851:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744864:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184179072:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744880:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184178688:12345-0@lo:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.744884:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d431dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184178688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744886:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788581329.744897:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788581329.744902:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184179200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744902:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184178944:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744920:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788581329.744927:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184178432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581329.744936:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184179200:12345-0@lo:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581329.744941:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:0.0:1788581329.744943:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43394380 x1875463184179200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581329.744952:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184179200:0@lo:400:kworker.0 00000100:00100000:0.0:1788581329.744990:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184178432:12345-0@lo:400:kworker.0 Request processed in 63us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581329.744996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788581329.745004:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184178432:0@lo:400:kworker.0 00000100:00080000:1.0:1788581329.745072:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581329.745076:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581329.745078:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581329.746492:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184178048:12345-0@lo:400:kworker.0 Request processed in 4024us (4654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581329.746504:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788581329.746809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184178048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581330.106953:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581330.107070:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170462848 00000100:00100000:0.0:1788581330.107080:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170462848 00000100:00100000:0.0:1788581330.107155:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581330.107167:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:11176:x1875463170462848:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1788581330.107193:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581330.107221:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2202d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.107379:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2ffe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.107392:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2ffe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.107406:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2ffe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581330.107417:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788581330.107539:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b2ffdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2202d expref: 39 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.107557:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2ffe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2202d expref: 38 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.107565:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581330.107568:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581330.107571:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71200, rc 0) 00000100:00080000:1.0:1788581330.107985:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581330.108113:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11176:x1875463170462848:12345-192.168.203.3@tcp:101:cat.0 Request processed in 946us (1167us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788581330.108138:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1788581330.114452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581330.115520:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170462976 00000100:00100000:0.0:1788581330.115531:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170462976 00000100:00100000:0.0:1788581330.115646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1788581330.115657:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:2393:x1875463170462976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581330.115672:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581330.115841:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b2ffe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2202d expref: 38 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.115863:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581330.115868:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581330.115935:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:2393:x1875463170462976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 279us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581330.115942:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581330.124854:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581330.125029:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170463232 00000100:00100000:0.0:1788581330.125040:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170463232 00000100:00100000:0.0:1788581330.125096:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1788581330.125106:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:11176:x1875463170463232:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:0.0:1788581330.125604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11176:x1875463170463232:12345-192.168.203.3@tcp:35:cat.0 Request processed in 497us (758us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788581330.125613:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581330.223640:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.223834:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170463488 00000100:00100000:2.0:1788581330.223844:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170463488 00000100:00100000:2.0:1788581330.223906:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1788581330.223917:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11182:x1875463170463488:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1788581330.223942:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581330.223945:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788581330.223970:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b2ff4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22003 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224007:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581330.224012:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581330.224026:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fff4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22034 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224126:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224141:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 38 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224149:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224180:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 38 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.224193:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 38 pid: 11562 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581330.224219:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184179328:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581330.224697:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581330.230308:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184179328:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581330.230338:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581330.230598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.230808:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170463616 00000100:00100000:2.0:1788581330.230828:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170463616 00010000:00010000:2.0:1788581330.230862:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 39 pid: 11562 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581330.230904:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1788581330.230913:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:2395:x1875463170463616:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581330.230927:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581330.230933:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 39 pid: 11562 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.230945:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 39 pid: 11562 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.230966:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b2ffca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22026 expref: 39 pid: 11562 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.230983:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581330.230987:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.230997:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.231004:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.231034:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581330.231678:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:2395:x1875463170463616:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 763us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581330.231698:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00010000:00010000:3.0:1788581330.231767:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.231775:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581330.231793:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788581330.231927:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b2fff4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.231943:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.231952:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581330.231954:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581330.231957:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:3.0:1788581330.231987:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11182:x1875463170463488:12345-192.168.203.3@tcp:101:dd.0 Request processed in 8073us (8373us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788581330.231994:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1788581330.236448:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.236540:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170463744 00000100:00100000:2.0:1788581330.236673:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170463744 00000100:00100000:0.0:1788581330.236851:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:0.0:1788581330.236863:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11182:x1875463170463744:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1788581330.236887:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581330.236906:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b30009 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2203b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.236956:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.236970:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.236980:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.237101:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b30009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 40 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.237119:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581330.237127:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581330.237129:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581330.237133:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581330.237377:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:11182:x1875463170463744:12345-192.168.203.3@tcp:101:dd.0 Request processed in 515us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581330.237386:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:0.0:1788581330.244972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.245057:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464000 00000100:00100000:2.0:1788581330.245067:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464000 00000100:00100000:2.0:1788581330.245127:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1788581330.245137:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:11182:x1875463170464000:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:2.0:1788581330.245441:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.245460:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.245472:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581330.245514:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788581330.245538:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acd7b1b6 reply state 000000003d4a27cb transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.245551:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.245559:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581330.245562:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581330.245565:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581330.245661:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:11182:x1875463170464000:12345-192.168.203.3@tcp:36:dd.0 Request processed in 525us (697us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788581330.245669:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:2.0:1788581330.245674:0:9504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788581330.626129:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581330.656232:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.656868:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464128 00000100:00100000:2.0:1788581330.656878:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464128 00000100:00100000:2.0:1788581330.656937:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581330.656948:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:11196:x1875463170464128:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1788581330.656973:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581330.656993:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b3001e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22042 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657058:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657073:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657084:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657097:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657104:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657132:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657213:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657224:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657294:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657327:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.657341:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 43 pid: 6493 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581330.657356:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184179456:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581330.657474:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581330.661148:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184179456:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581330.661180:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581330.664611:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581330.673384:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464384 00000100:00100000:0.0:1788581330.673398:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464384 00000100:00100000:0.0:1788581330.673460:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1788581330.673469:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:6161:x1875463170464384:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788581330.673934:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+45:6161:x1875463170464384:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 464us (9329us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788581330.673956:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581330.686010:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.686091:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464512 00000100:00100000:2.0:1788581330.686100:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464512 00010000:00010000:2.0:1788581330.686139:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 45 pid: 6493 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581330.686189:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1788581330.686210:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+45:2395:x1875463170464512:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581330.686224:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581330.686239:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 45 pid: 6493 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686463:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 45 pid: 6493 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686485:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b2fffb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22034 expref: 45 pid: 6493 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686502:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581330.686507:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686516:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686523:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.686555:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581330.686616:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:2395:x1875463170464512:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 415us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581330.686625:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00010000:00010000:3.0:1788581330.687591:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687602:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581330.687666:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788581330.687670:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581330.687709:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687723:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687732:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687738:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687744:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687750:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40030600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581330.687754:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687761:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687773:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581330.687787:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581330.687792:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687799:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e40030600/0x50f0cc74b7b30025 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687952:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687960:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687965:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687970:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581330.687974:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687980:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.687988:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:3.0:1788581330.688038:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581330.688043:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.688048:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3002c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.688085:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b3001e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22042 expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.688116:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22042 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581330.688124:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581330.688126:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581330.688129:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273200, rc 0) 00000100:00100000:3.0:1788581330.688593:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:11196:x1875463170464128:12345-192.168.203.3@tcp:101:stat.0 Request processed in 31644us (32375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581330.688602:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581330.753606:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184179584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581330.753696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581330.753882:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184179584 00000100:00100000:0.0:1788581330.753890:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184179584 00000100:00100000:0.0:1788581330.753939:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788581330.753948:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184179584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581330.753980:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581330.754046:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184179584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581330.754053:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788581330.754272:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184179584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581330.824450:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581330.824552:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464768 00000100:00100000:2.0:1788581330.824562:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464768 00000100:00100000:2.0:1788581330.824637:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581330.824648:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:11202:x1875463170464768:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:2.0:1788581330.824701:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581330.824738:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22042 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.824756:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581330.824761:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581330.824917:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.824930:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.824940:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581330.824977:0:11562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788581330.824997:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083b90607 reply state 000000008d6702cf transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.825008:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581330.825015:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581330.825017:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581330.825020:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581330.825129:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+45:11202:x1875463170464768:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 483us (689us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788581330.825136:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000020:00080000:2.0:1788581330.825141:0:11562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788581331.043453:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581331.043549:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170464896 00000100:00100000:0.0:1788581331.043559:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170464896 00000100:00100000:0.0:1788581331.043636:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1788581331.043648:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+45:11216:x1875463170464896:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:0.0:1788581331.043672:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581331.043704:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b30041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22049 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043770:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043783:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043796:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043808:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043834:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043842:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043915:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043925:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.043932:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581331.043988:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788581331.043993:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581331.044015:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044026:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044034:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044040:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044047:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044062:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581331.044066:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044074:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044088:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581331.044091:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581331.044095:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044102:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30048 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044117:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044122:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044127:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044132:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581331.044134:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044140:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044159:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:0.0:1788581331.044161:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581331.044165:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044171:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3004f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044210:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b30041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 47 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044224:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.044231:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581331.044234:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581331.044236:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581331.044354:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+46:11216:x1875463170464896:12345-192.168.203.3@tcp:101:stat.0 Request processed in 708us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581331.044361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:1.0:1788581331.152633:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.152836:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170465152 00000100:00100000:3.0:1788581331.152847:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170465152 00000100:00100000:3.0:1788581331.152911:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1788581331.152923:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+46:11226:x1875463170465152:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581331.152944:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581331.152963:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b3005d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22050 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581331.153070:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788581331.153174:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b3005d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22050 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.153189:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581331.153193:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581331.153207:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b3005d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22050 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.153238:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581331.153354:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:11226:x1875463170465152:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 433us (730us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788581331.153361:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1788581331.158569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581331.160122:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170465408 00000100:00100000:0.0:1788581331.160134:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170465408 00000100:00100000:0.0:1788581331.160268:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1788581331.160279:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:11226:x1875463170465408:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581331.160507:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:11226:x1875463170465408:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 229us (1944us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788581331.160515:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1788581331.252860:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581331.254154:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170465664 00000100:00100000:1.0:1788581331.254166:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170465664 00000100:00100000:1.0:1788581331.254333:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1788581331.254345:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:11233:x1875463170465664:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581331.254384:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581331.254406:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b3006b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22057 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.254514:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.254530:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 49 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.254539:0:11562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.254574:0:11562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 49 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.254587:0:11562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 49 pid: 6494 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581331.254600:0:11562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4303b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184179712:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581331.254719:0:11562:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54da5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581331.257764:0:11562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4303b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184179712:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581331.257796:0:11562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581331.261173:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581331.261520:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170465792 00000100:00100000:1.0:1788581331.261535:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170465792 00010000:00010000:1.0:1788581331.261592:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 50 pid: 6494 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581331.261656:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581331.261669:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:2396:x1875463170465792:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581331.261712:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581331.261722:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 50 pid: 6494 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261739:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 50 pid: 6494 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261769:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22049 expref: 50 pid: 6494 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261791:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581331.261797:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261809:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261819:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.261864:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581331.261943:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:2396:x1875463170465792:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 277us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581331.261952:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00010000:00010000:3.0:1788581331.262448:0:11562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.262460:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581331.262497:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788581331.262841:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b3006b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 50 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.262864:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 49 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.262874:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581331.262878:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581331.262881:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:3.0:1788581331.262937:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:11233:x1875463170465664:12345-192.168.203.3@tcp:101:bash.0 Request processed in 8594us (10086us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788581331.262947:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1788581331.271571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581331.271733:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466048 00000100:00100000:2.0:1788581331.271744:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466048 00000100:00100000:2.0:1788581331.271858:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:2.0:1788581331.271870:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:11233:x1875463170466048:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:2.0:1788581331.272109:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.272127:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.272153:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581331.272204:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788581331.272229:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6040d64 reply state 00000000eb5bc171 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.272242:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.272250:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581331.272294:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581331.272299:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581331.272393:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:11233:x1875463170466048:12345-192.168.203.3@tcp:36:bash.0 Request processed in 524us (830us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788581331.272401:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000020:00080000:2.0:1788581331.272406:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788581331.284120:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581331.284203:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466176 00000100:00100000:0.0:1788581331.284213:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466176 00000100:00100000:0.0:1788581331.284289:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1788581331.284299:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:11233:x1875463170466176:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581331.284322:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581331.284339:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2205e expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.284420:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.284434:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 53 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.284444:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.284473:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 53 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.284485:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 53 pid: 11562 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581331.284498:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184179840:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581331.284563:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581331.299994:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.300349:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466304 00000100:00100000:3.0:1788581331.300358:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466304 00010000:00010000:3.0:1788581331.300396:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 54 pid: 11562 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581331.300435:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1788581331.300445:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:2395:x1875463170466304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581331.300458:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581331.300465:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 54 pid: 11562 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.300478:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 54 pid: 11562 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.300499:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581331.300505:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.300514:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.300521:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.300539:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581331.300584:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:2395:x1875463170466304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 140us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581331.300593:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00010000:00010000:2.0:1788581331.300741:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30072 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22057 expref: 53 pid: 11562 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581331.300789:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184179840:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581331.300809:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.300818:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.300824:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581331.300875:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788581331.300880:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581331.300899:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.300929:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2205e expref: 53 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.300942:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2205e expref: 52 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.300949:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581331.300952:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581331.300954:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71a00, rc 0) 00000100:00100000:2.0:1788581331.300981:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:11233:x1875463170466176:12345-192.168.203.3@tcp:101:bash.0 Request processed in 16684us (16870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581331.300987:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1788581331.305694:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.305771:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466560 00000100:00100000:3.0:1788581331.305792:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466560 00000100:00100000:3.0:1788581331.305843:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1788581331.305852:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:11233:x1875463170466560:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1788581331.306060:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11233:x1875463170466560:12345-192.168.203.3@tcp:35:bash.0 Request processed in 207us (373us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788581331.306068:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1788581331.392697:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.392779:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466816 00000100:00100000:3.0:1788581331.392789:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466816 00000100:00100000:3.0:1788581331.392846:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1788581331.392856:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11243:x1875463170466816:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581331.392882:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581331.392902:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22065 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581331.392998:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788581331.393093:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22065 expref: 55 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.393108:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581331.393111:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581331.393116:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22065 expref: 55 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.393130:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581331.393209:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11243:x1875463170466816:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 354us (520us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788581331.393216:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1788581331.398463:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581331.398555:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170466944 00000100:00100000:2.0:1788581331.398564:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170466944 00000100:00100000:2.0:1788581331.398633:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1788581331.398644:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11243:x1875463170466944:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1788581331.398727:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398744:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398755:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398766:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398774:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398780:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398849:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398859:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398866:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581331.398914:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398941:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398947:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398954:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398960:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.398964:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398971:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398983:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581331.398987:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581331.398992:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.398998:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399009:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399015:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399022:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399032:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.399036:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399042:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:2.0:1788581331.399052:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581331.399055:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399061:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399071:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399078:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399084:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399089:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.399092:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399098:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399119:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581331.399121:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581331.399124:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.399131:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581331.399303:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11243:x1875463170466944:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 659us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581331.399311:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:1.0:1788581331.404508:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.404603:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170467200 00000100:00100000:3.0:1788581331.404613:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170467200 00000100:00100000:3.0:1788581331.404734:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581331.404744:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11243:x1875463170467200:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581331.404957:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:11243:x1875463170467200:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 214us (458us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788581331.404966:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1788581331.485172:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581331.485307:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170467456 00000100:00100000:2.0:1788581331.485317:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170467456 00000100:00100000:2.0:1788581331.485379:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581331.485390:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:11246:x1875463170467456:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581331.485413:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581331.485432:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2206c expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485509:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485524:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485534:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485546:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485566:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485574:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485688:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b300cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485699:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b300cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485707:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b300cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581331.485717:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788581331.485787:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485795:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485801:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485807:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.485811:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485818:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485842:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581331.485846:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581331.485851:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485858:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b300bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485871:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485877:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485883:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485888:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.485891:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485898:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485905:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:2.0:1788581331.485907:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581331.485910:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485916:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b300c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485963:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2206c expref: 58 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485976:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b300cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2206c expref: 57 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.485983:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581331.485986:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581331.485988:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273200, rc 0) 00000100:00100000:2.0:1788581331.486061:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11246:x1875463170467456:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 672us (897us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788581331.486068:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1788581331.493646:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581331.493722:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581331.495442:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170467584 00000100:00100000:2.0:1788581331.495467:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170467584 00000100:00100000:2.0:1788581331.495539:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1788581331.495548:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11246:x1875463170467584:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1788581331.495612:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495629:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495639:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495672:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495694:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495701:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495707:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581331.495711:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495718:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495730:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581331.495732:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581331.495737:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.495743:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b300db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581331.495827:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11246:x1875463170467584:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 279us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581331.495835:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:3.0:1788581331.499204:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170467712 00000100:00100000:3.0:1788581331.499219:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170467712 00000100:00100000:3.0:1788581331.499879:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581331.499891:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:2395:x1875463170467712:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581331.499907:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581331.499932:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b300cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2206c expref: 57 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.499952:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581331.499957:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581331.500023:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:2395:x1875463170467712:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 134us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581331.500031:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1788581331.500129:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581331.500288:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170467968 00000100:00100000:0.0:1788581331.500306:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170467968 00000100:00100000:0.0:1788581331.500339:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1788581331.500346:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:11246:x1875463170467968:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581331.500559:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11246:x1875463170467968:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 212us (429us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788581331.500566:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00010000:00010000:0.0:1788581331.649483:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581331.718564:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.720346:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170468224 00000100:00100000:3.0:1788581331.720358:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170468224 00000100:00100000:3.0:1788581331.720429:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1788581331.720440:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11264:x1875463170468224:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1788581331.720464:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581331.720483:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b300e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22073 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.720617:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b300e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.720638:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b300e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.720650:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b300e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581331.720661:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788581331.720787:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b300e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22073 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.720804:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b300e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22073 expref: 59 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.720983:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581331.720987:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788581331.720991:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581331.721059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:11264:x1875463170468224:12345-192.168.203.3@tcp:101:cat.0 Request processed in 622us (2504us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788581331.721066:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000001:00080000:0.0:1788581331.726378:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:0.0:1788581331.726445:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788581331.726468:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995d4239fcc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788581331.726473:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e43fb5d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995d4239f600 00000020:00080000:0.0:1788581331.726476:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e43fb5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995e7a699e00 00010000:00010000:1.0:1788581331.727817:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727833:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727840:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727846:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.727851:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727858:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727876:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff995d42038a00) 00010000:00010000:1.0:1788581331.727879:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.727884:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727890:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b2fec7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727913:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727919:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727925:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727946:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.727950:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727955:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727963:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581331.727966:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.727968:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727974:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b2fece lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727989:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.727995:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728000:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728005:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.728007:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728013:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728030:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:1.0:1788581331.728032:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.728035:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728041:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b2ff0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728059:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728065:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728070:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728074:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.728077:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728082:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728088:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581331.728090:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.728093:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728097:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30017 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728116:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728123:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728129:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728134:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.728136:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728142:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728151:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581331.728153:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.728155:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728161:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3003a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728170:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728175:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728181:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728202:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581331.728206:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728211:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728220:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581331.728222:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581331.728225:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.728232:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30080 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788581331.728316:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788581331.728397:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4303b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184179968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788581331.728464:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788581331.728489:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788581331.728521:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184179968 00000100:00100000:2.0:1788581331.728529:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184179968 00000100:00080000:1.0:1788581331.728567:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581331.728585:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581331.728596:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184179968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788581331.728633:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788581331.728660:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b95d1, atime: 0x6a9b95d1, ctime: 0x6a9b95d1, blocks: 0x8 00010000:00010000:2.0:1788581331.728667:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.728680:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1788581331.728684:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581331.728690:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.728703:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.728712:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.728719:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.728742:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581331.728863:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184179968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 268us (398us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788581331.728870:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1788581331.728953:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e4303b480/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788581331.728960:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4303b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184179968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788581331.733283:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581331.733297:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.733310:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581331.733315:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.733326:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.733370:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.733378:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b300f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581331.733399:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581331.733402:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581331.733403:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581331.778853:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.779020:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170468352 00000100:00100000:3.0:1788581331.779030:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170468352 00000100:00100000:3.0:1788581331.779091:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:3.0:1788581331.779116:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11265:x1875463170468352:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581331.779151:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581331.779171:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b300fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2207a expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.779250:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.779308:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.779320:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581331.779909:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788581331.779915:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581331.779940:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.779987:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b300fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2207a expref: 15 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.780007:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2207a expref: 14 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.780016:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581331.780019:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581331.780022:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981200, rc 0) 00000100:00100000:2.0:1788581331.780090:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11265:x1875463170468352:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 976us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581331.780098:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:0.0:1788581331.794340:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.794431:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170468736 00000100:00100000:3.0:1788581331.794441:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170468736 00000100:00100000:3.0:1788581331.794490:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581331.794500:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11265:x1875463170468736:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581331.794776:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11265:x1875463170468736:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 276us (444us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788581331.794784:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1788581331.798069:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581331.798150:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170468864 00000100:00100000:3.0:1788581331.798159:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170468864 00000100:00100000:3.0:1788581331.798284:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581331.798295:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11265:x1875463170468864:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:3.0:1788581331.798309:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788581331.798332:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3008e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2205e expref: 15 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.798370:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b300e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22073 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.798381:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b2ff8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22018 expref: 13 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581331.798390:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581331.798395:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581331.798452:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11265:x1875463170468864:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 159us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581331.798459:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1788581331.802875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581331.803021:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170468992 00000100:00100000:2.0:1788581331.803030:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170468992 00000100:00100000:2.0:1788581331.803089:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1788581331.803100:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11265:x1875463170468992:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:2.0:1788581331.803241:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.803289:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581331.803301:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581331.803523:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581331.803902:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788581331.803996:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788581331.804077:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11265:x1875463170468992:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 976us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581331.804086:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1788581331.834708:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581331.834805:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170469120 00000100:00100000:0.0:1788581331.834823:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170469120 00000100:00100000:0.0:1788581331.834879:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:0.0:1788581331.834888:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:11267:x1875463170469120:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581331.834907:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581331.834925:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30113 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22081 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.834985:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.834997:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835025:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835040:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835046:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835052:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835120:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835129:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835135:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581331.835176:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788581331.835180:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581331.835207:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835219:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835227:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835244:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835250:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835294:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581331.835298:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835305:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835318:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581331.835321:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581331.835326:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835332:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3011a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835345:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835351:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835356:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835361:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581331.835370:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835376:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835385:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e4eb16a00) 00010000:00010000:0.0:1788581331.835387:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581331.835390:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835396:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835428:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30113 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 14 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835440:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 13 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581331.835447:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581331.835450:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581331.835452:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71400, rc 0) 00000100:00100000:0.0:1788581331.835503:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11267:x1875463170469120:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 615us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581331.835510:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000040:00080000:2.0:1788581332.358242:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581332.358268:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581332.358316:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788581332.358324:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581332.360285:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7a640a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184180096:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581332.360384:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581332.364378:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7a640a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184180096:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581332.372831:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.373098:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170469248 00000100:00100000:2.0:1788581332.373108:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170469248 00000100:00100000:2.0:1788581332.373182:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:2.0:1788581332.373208:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11278:x1875463170469248:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788581332.373243:0:11562:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788581332.373389:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11278:x1875463170469248:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 184us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.373397:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00080000:1.0:1788581332.373804:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581332.384222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.384325:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170469376 00000100:00100000:2.0:1788581332.384336:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170469376 00000100:00100000:2.0:1788581332.384398:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:2.0:1788581332.384409:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11278:x1875463170469376:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788581332.384485:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384502:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384532:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384550:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384557:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384564:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384590:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384598:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384605:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581332.384649:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788581332.384653:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581332.384668:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384677:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384683:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384699:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384706:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.384709:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384716:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384727:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:2.0:1788581332.384730:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581332.384734:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384739:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3012f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384751:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384757:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384762:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384766:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.384769:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384784:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384791:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff995d42038f00) 00010000:00010000:2.0:1788581332.384793:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581332.384796:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384802:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30136 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384816:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384822:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384828:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384833:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.384836:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384841:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384848:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581332.384851:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581332.384854:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.384870:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3013d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581332.384949:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e477b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11278:x1875463170469376:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 539us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.384956:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:0.0:1788581332.389796:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.389994:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170469632 00000100:00100000:3.0:1788581332.390005:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170469632 00000100:00100000:3.0:1788581332.390062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1788581332.390073:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11278:x1875463170469632:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.390094:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581332.390114:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30144 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22088 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.390228:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.390242:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.390937:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581332.390968:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788581332.391053:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391062:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391069:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391075:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581332.391080:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391087:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391099:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581332.391102:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581332.391106:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391113:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b3014b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391152:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30144 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22088 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391162:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:3.0:1788581332.391165:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581332.391185:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30144 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22088 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.391206:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581332.391301:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170469632:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1229us (1512us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788581332.391310:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:1.0:1788581332.395766:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.395968:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170469760 00000100:00100000:2.0:1788581332.395977:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170469760 00000100:00100000:2.0:1788581332.396032:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:2.0:1788581332.396044:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170469760:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788581332.396076:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788581332.396198:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170469760:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 148us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.396206:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1788581332.406229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.406336:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470016 00000100:00100000:1.0:1788581332.406346:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470016 00000100:00100000:1.0:1788581332.406410:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:1.0:1788581332.406421:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170470016:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581332.406442:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581332.406445:0:9504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788581332.406471:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2207a expref: 14 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.406491:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581332.406495:0:9504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581332.406520:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30159 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2208f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581332.407010:0:9504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788581332.407131:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.407145:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.407154:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.407208:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30159 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2208f expref: 16 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.407224:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2208f expref: 15 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.407231:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51bef200) 00010000:00010000:1.0:1788581332.407234:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581332.407236:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581332.407454:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e71ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170470016:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1233us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788581332.407462:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:0.0:1788581332.414834:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.414944:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470272 00000100:00100000:3.0:1788581332.414954:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470272 00000100:00100000:2.0:1788581332.415068:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1788581332.415079:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170470272:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581332.415135:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581332.415161:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2208f expref: 15 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415177:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51bef200) 00010000:00010000:2.0:1788581332.415197:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581332.415220:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415234:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415281:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415297:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415304:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415361:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415524:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415532:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415538:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415543:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.415547:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415554:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415562:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581332.415565:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581332.415569:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415581:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3016e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415590:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415596:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415602:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415608:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.415611:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415617:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415625:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x88b0cc6f (ffff995d42038f00) 00010000:00010000:2.0:1788581332.415627:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581332.415630:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.415636:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30175 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x88b0cc6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581332.415717:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170470272:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 640us (892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581332.415725:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1788581332.424157:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.426618:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470400 00000100:00100000:1.0:1788581332.426632:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470400 00000100:00100000:1.0:1788581332.426694:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1788581332.426705:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170470400:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581332.426741:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581332.426764:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3017c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22096 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426801:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426815:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426826:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426954:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3017c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426971:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.426979:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:1.0:1788581332.426982:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788581332.426986:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b400, rc 0) 00000100:00100000:1.0:1788581332.427057:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170470400:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 354us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.427064:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1788581332.439151:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.439225:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470656 00000100:00100000:3.0:1788581332.439235:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470656 00000100:00100000:1.0:1788581332.439719:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:1.0:1788581332.439731:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170470656:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581332.439818:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.439835:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.439847:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581332.440003:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788581332.440013:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318581758327ns, next at 319581756078ns, rc = 0 00000004:00010000:1.0:1788581332.440058:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062897d51 reply state 000000001ff8e5b0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.440071:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.440079:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:1.0:1788581332.440082:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788581332.440085:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581332.440180:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11278:x1875463170470656:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 450us (1035us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788581332.440198:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:0.0:1788581332.451879:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.452207:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470784 00000100:00100000:3.0:1788581332.452217:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470784 00000100:00100000:3.0:1788581332.452473:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:3.0:1788581332.452485:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11278:x1875463170470784:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.452509:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581332.452527:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2209d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.452584:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.452599:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.452627:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.452630:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581332.452644:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581332.452704:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11278:x1875463170470784:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 221us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.452711:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:1.0:1788581332.459138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.459242:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170470912 00000100:00100000:3.0:1788581332.459317:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170470912 00000100:00100000:3.0:1788581332.459359:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1788581332.459367:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170470912:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788581332.459399:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:3.0:1788581332.459434:0:8410:0:(genops.c:1385:class_connect()) connect: client 36c1c238-f3ab-41d9-b90e-c3af2be29807, cookie 0x50f0cc74b7b30198 00002000:00100000:3.0:1788581332.459460:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36c1c238-f3ab-41d9-b90e-c3af2be29807/ffff995d43a87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581332.459476:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581332.459548:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581332.459575:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995d43a85000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581332.459658:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2392:x1875463170470912:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 Request processed in 290us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.459666:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1788581332.466554:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.466637:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170471040 00000100:00100000:3.0:1788581332.466647:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170471040 00000100:00100000:3.0:1788581332.466709:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1788581332.466719:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:0:x1875463170471040:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788581332.467610:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788581332.468347:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788581332.468355:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000100:00100000:3.0:1788581332.468513:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:0:x1875463170471040:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 1791us (1963us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788581332.468523:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1788581332.472421:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.472481:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170471296 00000100:00100000:3.0:1788581332.472497:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170471296 00000100:00100000:3.0:1788581332.472604:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1788581332.472615:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11278:x1875463170471296:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581332.472848:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11278:x1875463170471296:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 234us (434us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788581332.472856:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1788581332.476206:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.476317:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170471552 00000100:00100000:0.0:1788581332.476335:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170471552 00000100:00100000:0.0:1788581332.476434:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:0.0:1788581332.476445:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11278:x1875463170471552:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581332.476562:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11278:x1875463170471552:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.476569:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:3.0:1788581332.479245:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.479987:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170471680 00000100:00100000:1.0:1788581332.480004:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170471680 00000100:00100000:1.0:1788581332.480054:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:1.0:1788581332.480064:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11278:x1875463170471680:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581332.480084:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581332.480103:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3019f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220a4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480179:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480203:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480218:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581332.480275:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581332.480306:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480335:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3019f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220a4 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480352:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220a4 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.480361:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:1.0:1788581332.480365:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788581332.480368:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a200, rc 0) 00000100:00100000:1.0:1788581332.480422:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11278:x1875463170471680:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 359us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.480435:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:3.0:1788581332.484075:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.484315:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170471808 00000100:00100000:1.0:1788581332.484324:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170471808 00000100:00100000:1.0:1788581332.484373:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581332.484382:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170471808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581332.484400:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581332.484418:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220ab expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581332.484541:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b95d4, blocks: 0x0 00010000:00010000:1.0:1788581332.484562:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1788581332.484566:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581332.484575:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 6 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.484594:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 6 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.484607:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581332.484886:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2393:x1875463170471808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 505us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.484892:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581332.493875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.493933:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472064 00000100:00100000:3.0:1788581332.493943:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472064 00000100:00100000:3.0:1788581332.493998:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1788581332.494008:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11278:x1875463170472064:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581332.494111:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11278:x1875463170472064:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.494119:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:2.0:1788581332.498885:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.498989:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472192 00000100:00100000:3.0:1788581332.498998:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472192 00000100:00100000:3.0:1788581332.499057:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:3.0:1788581332.499069:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:11278:x1875463170472192:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.499086:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581332.499105:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220b2 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.499135:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.499158:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581332.499162:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581332.499167:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.499214:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.499228:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.499243:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184180224:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581332.499349:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581332.507602:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184180224:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581332.507637:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.507658:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980200, rc 0) 00000100:00100000:0.0:1788581332.507729:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11278:x1875463170472192:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 8662us (8851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.507738:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1788581332.508435:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.508857:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472320 00000100:00100000:0.0:1788581332.508865:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472320 00010000:00010000:0.0:1788581332.508900:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.508939:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581332.508949:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170472320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581332.508961:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581332.508982:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.509008:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.509033:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b02204/0x50f0cc74b7b301ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ab expref: 7 pid: 8410 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.509046:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581332.509051:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581332.509059:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.509071:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.509104:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.509120:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875463184180352:192.168.203.3@tcp:105: 00000100:00100000:0.0:1788581332.509213:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581332.513535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.513661:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472448 00000100:00100000:1.0:1788581332.513670:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472448 00002000:00100000:1.0:1788581332.513724:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff995d43835f80 x1875463170472448/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:688/0 lens 504/0 e 0 to 0 dl 1788581343 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581332.513734:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43835f80 with x1875463170472448 ext(0->8) 00002000:00010000:1.0:1788581332.513740:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43835f80 00000100:00100000:1.0:1788581332.513775:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1788581332.513785:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170472448:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788581332.514326:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875463184180352:192.168.203.3@tcp:105: 00010000:00010000:0.0:1788581332.514348:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581332.514398:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170472320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5451us (5966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.514408:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581332.515086:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170472448:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 1299us (1556us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788581332.515100:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:0.0:1788581332.515110:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff995d43835f80 x1875463170472448/t4294967303(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:688/0 lens 504/448 e 0 to 0 dl 1788581343 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581332.515119:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43835f80 with x1875463170472448 ext(0->8) 00002000:00010000:0.0:1788581332.515124:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43835f80 00000100:00100000:3.0:1788581332.518155:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.518233:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472576 00000100:00100000:1.0:1788581332.518242:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472576 00000100:00100000:1.0:1788581332.518334:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:1.0:1788581332.518343:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11278:x1875463170472576:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788581332.520585:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00010000:00010000:2.0:1788581332.520693:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520706:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520715:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520721:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581332.520726:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520733:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520750:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:2.0:1788581332.520753:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581332.520759:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.520766:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3018a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581332.520804:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1788581332.521312:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581332.521332:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184180480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788581332.521400:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581332.521516:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184180480 00000100:00100000:3.0:1788581332.521523:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184180480 00000100:00100000:3.0:1788581332.521574:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581332.521583:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184180480:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788581332.521779:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788581332.521918:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788581332.521922:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788581332 00002000:00010000:3.0:1788581332.521924:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788581332.521938:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788581332 -> 1788581332 00002000:00010000:3.0:1788581332.521940:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788581332.522022:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184180480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 439us (620us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788581332.522030:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:0.0:1788581332.522141:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788581332.522203:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788581332.522214:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788581332.522519:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170472576:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 4174us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.522529:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00000004:00080000:2.0:1788581332.523070:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d4339e680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788581332.523079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184180480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788581332.525567:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.525640:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472704 00000100:00100000:2.0:1788581332.525660:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472704 00000100:00100000:2.0:1788581332.525709:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1788581332.525719:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170472704:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788581332.527665:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788581332.527678:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788581332.527872:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170472704:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 2150us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.527883:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1788581332.536953:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.537031:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170472960 00000100:00100000:3.0:1788581332.537041:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170472960 00000100:00100000:3.0:1788581332.537107:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1788581332.537117:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170472960:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.537180:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581332.537218:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b301a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220a4 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.537237:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.537242:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581332.537316:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.537330:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.537339:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581332.537454:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001955fe23 reply state 000000009eca384c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.537484:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.537490:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.537493:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581332.537495:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581332.537597:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170472960:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 480us (651us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788581332.537604:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1788581332.543005:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.544493:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473088 00000100:00100000:1.0:1788581332.544505:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473088 00000100:00100000:1.0:1788581332.544604:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1788581332.544614:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170473088:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581332.544759:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788581332.544763:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788581332 -> 1788581331 00002000:00010000:1.0:1788581332.544765:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788581329 00002000:00010000:1.0:1788581332.544768:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788581332 -> 1788581331 00002000:00010000:1.0:1788581332.544769:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788581332.544846:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170473088:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 233us (1849us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788581332.544854:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1788581332.547965:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.548231:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473344 00000100:00100000:3.0:1788581332.548241:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473344 00000100:00100000:3.0:1788581332.548535:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1788581332.548548:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:11278:x1875463170473344:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.548612:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.548641:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.548650:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.548684:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.548698:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 15 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.548730:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184180608:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581332.548871:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581332.559115:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.559203:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473472 00000100:00100000:0.0:1788581332.559212:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473472 00010000:00010000:0.0:1788581332.559249:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 16 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.559309:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1788581332.559318:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:2395:x1875463170473472:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581332.559331:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581332.559337:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 16 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.559351:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 16 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.559528:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:0.0:1788581332.559535:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.559558:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.559566:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.559585:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581332.559639:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:2395:x1875463170473472:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 321us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.559647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00010000:00010000:3.0:1788581332.560783:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22096 expref: 15 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.560805:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184180608:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581332.560823:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560831:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560837:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560871:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560877:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560885:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560890:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581332.560894:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560900:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560924:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.560927:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788581332.560931:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.560936:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.561003:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170473344:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 12458us (13046us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788581332.561011:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:1.0:1788581332.563416:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.563552:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473600 00000100:00100000:0.0:1788581332.563562:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473600 00000100:00100000:0.0:1788581332.563615:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:0.0:1788581332.563634:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170473600:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788581332.563678:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.563698:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.563706:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581332.563711:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581332.563716:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.563750:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.563777:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 7 pid: 8409 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.563792:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184180736:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581332.563865:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581332.569093:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184180736:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581332.569134:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581332.572462:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.573549:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473728 00000100:00100000:3.0:1788581332.573560:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473728 00010000:00010000:3.0:1788581332.573598:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 8 pid: 8409 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.573646:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1788581332.573656:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170473728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581332.573669:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581332.573689:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 8 pid: 8409 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.573715:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 8 pid: 8409 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.573744:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b301b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220b2 expref: 8 pid: 8409 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.573759:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581332.573763:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581332.573769:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.573778:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.573811:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581332.573867:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170473728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 213us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.573875:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00010000:00010000:2.0:1788581332.574494:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574506:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574529:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574537:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574544:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574551:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581332.574555:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574563:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574587:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.574595:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b301c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581332.574668:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170473600:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 11035us (11257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.574676:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1788581332.581878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.581959:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170473984 00000100:00100000:3.0:1788581332.581970:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170473984 00000100:00100000:3.0:1788581332.582026:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:3.0:1788581332.582037:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11278:x1875463170473984:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788581332.582113:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.582130:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.582147:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.582180:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.582204:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 14 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.582218:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184180864:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581332.582750:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581332.596533:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.596591:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170474112 00000100:00100000:0.0:1788581332.596601:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170474112 00010000:00010000:0.0:1788581332.596647:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 15 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.596682:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:0.0:1788581332.596692:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:2395:x1875463170474112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581332.596706:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581332.596712:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 15 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.596726:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 15 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.596747:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:0.0:1788581332.596753:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.596764:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.596782:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.596801:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581332.596850:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:2395:x1875463170474112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 159us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.596858:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00010000:00010000:3.0:1788581332.597495:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2203b expref: 14 pid: 6495 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.597514:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184180864:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581332.597533:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597543:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597549:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597753:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597765:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597779:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597808:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.597823:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 14 pid: 6493 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.597837:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184180992:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581332.597899:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581332.600816:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184180992:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581332.600844:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.602138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581332.605621:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170474240 00000100:00100000:3.0:1788581332.605638:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170474240 00010000:00010000:3.0:1788581332.605685:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 15 pid: 6493 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.605776:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1788581332.605788:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:2396:x1875463170474240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581332.605815:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581332.605824:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 15 pid: 6493 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605851:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 15 pid: 6493 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605875:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30191 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2209d expref: 15 pid: 6493 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605888:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.605893:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605903:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605911:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.605937:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581332.605996:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:2396:x1875463170474240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 211us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.606005:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00010000:00010000:3.0:1788581332.606839:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.606851:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581332.606968:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788581332.607079:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788581332.607113:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788581332.608464:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9504:1875463184181120:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788581332.608529:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581332.608566:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581332.611217:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184181120 00000100:00100000:2.0:1788581332.611231:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184181120 00000100:00100000:2.0:1788581332.611310:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788581332.611322:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9504:x1875463184181120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788581332.611477:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9504:x1875463184181120:12345-0@lo:1000:mdt00_003.0 Request processed in 158us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.611484:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581332.611660:0:9504:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788581332.611668:0:9504:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d4339e680, transno 4294967304 00000100:00100000:3.0:1788581332.611692:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9504:1875463184181120:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788581332.611836:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788581332.611908:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9504:1875463184181248:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788581332.611945:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581332.611969:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581332.611986:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184181248 00000100:00100000:3.0:1788581332.611990:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184181248 00000100:00100000:3.0:1788581332.612018:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581332.612025:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9504:x1875463184181248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788581332.612117:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9504:x1875463184181248:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (171us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788581332.612124:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581332.612157:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9504:1875463184181248:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788581332.612401:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612412:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612419:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612425:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581332.612435:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612442:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612458:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:3.0:1788581332.612461:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581332.612464:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612471:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b301d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612499:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612505:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612511:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612515:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581332.612518:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612523:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612531:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:3.0:1788581332.612533:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581332.612542:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612549:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3010c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612570:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612584:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 17 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612593:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612790:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 17 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581332.612806:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 17 pid: 9504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.612819:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184181376:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581332.612881:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581332.624044:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184181376:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581332.624078:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581332.626989:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.627785:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170474368 00000100:00100000:2.0:1788581332.627795:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170474368 00010000:00010000:2.0:1788581332.627838:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 18 pid: 9504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581332.627965:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581332.627976:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170474368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581332.627990:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581332.628003:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 18 pid: 9504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628016:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 18 pid: 9504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628037:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30128 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22081 expref: 18 pid: 9504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628051:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:2.0:1788581332.628057:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628066:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628074:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581332.628106:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581332.628169:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:2396:x1875463170474368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 195us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581332.628176:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00010000:00010000:1.0:1788581332.628231:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628239:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628250:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628274:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628281:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628300:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581332.628305:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628313:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628323:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581332.628327:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581332.628337:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628343:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b301de lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628354:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628360:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628365:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628371:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581332.628374:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628380:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628387:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e4eb16600) 00010000:00010000:1.0:1788581332.628390:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788581332.628393:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.628399:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b301d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581332.628542:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11278:x1875463170473984:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 46506us (46674us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788581332.628551:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00000020:00080000:1.0:1788581332.628560:0:9504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788581332.628677:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581332.628682:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581332.628697:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788581332.628703:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581332.638966:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.639051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170474624 00000100:00100000:1.0:1788581332.639060:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170474624 00000100:00100000:1.0:1788581332.639142:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581332.639152:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11278:x1875463170474624:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788581332.639442:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788581332.639472:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788581332.639509:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639524:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639535:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639542:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639548:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639553:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.639566:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788581332.639937:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11278:x1875463170474624:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 784us (977us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788581332.639951:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000020:00080000:1.0:1788581332.639955:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788581332.640360:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581332.640366:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.640375:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581332.640379:0:10311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.640387:0:10311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.640402:0:10311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:1.0:1788581332.640404:0:10311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581332.640410:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.640416:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b301e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.640427:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581332.640429:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581332.640431:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581332.673477:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581332.720575:0:14176:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581332.720585:0:14176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581332.720611:0:14176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788581332.720631:0:14176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581332.801417:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184181504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581332.801491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581332.801644:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184181504 00000100:00100000:1.0:1788581332.801652:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184181504 00000100:00100000:1.0:1788581332.801701:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581332.801711:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184181504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581332.801740:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581332.801786:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184181504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.801793:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788581332.801811:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581332.801849:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184181504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581332.805097:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581332.805118:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581332.805177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581332.805324:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184181632 00000100:00100000:3.0:1788581332.805331:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184181632 00000100:00100000:3.0:1788581332.805382:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581332.805391:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184181632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581332.805412:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581332.805460:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184181632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581332.805467:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581332.805748:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581332.883463:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.883525:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170474880 00000100:00100000:0.0:1788581332.883536:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170474880 00000100:00100000:0.0:1788581332.883594:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:0.0:1788581332.883606:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:11288:x1875463170474880:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581332.883630:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581332.883650:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b301ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.883791:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b301f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.883804:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b301f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.883817:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b301f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581332.883838:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788581332.883939:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b301ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b9 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.883953:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b301f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b9 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.885306:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581332.885310:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788581332.885314:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70200, rc 0) 00000100:00100000:0.0:1788581332.885388:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11288:x1875463170474880:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1782us (1929us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788581332.885396:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:3.0:1788581332.899857:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581332.901330:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170475008 00000100:00100000:1.0:1788581332.901341:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170475008 00000100:00100000:1.0:1788581332.901436:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:1.0:1788581332.901446:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11288:x1875463170475008:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:1.0:1788581332.901515:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901531:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901543:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901557:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901564:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901592:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901668:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901676:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901683:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581332.901726:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901738:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901744:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901750:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901755:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581332.901759:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901766:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901777:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581332.901786:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581332.901791:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901796:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30201 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901809:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901815:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901820:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901825:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581332.901828:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901834:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901841:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e7a659900) 00010000:00010000:1.0:1788581332.901843:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581332.901846:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901851:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901863:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901876:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901881:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901886:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581332.901889:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901895:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901902:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995e7a659500) 00010000:00010000:1.0:1788581332.901904:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581332.901907:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581332.901912:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3020f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581332.901991:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11288:x1875463170475008:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 546us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581332.901999:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1788581332.950096:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.950177:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170475264 00000100:00100000:0.0:1788581332.950195:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170475264 00000100:00100000:0.0:1788581332.950274:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:0.0:1788581332.950286:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11291:x1875463170475264:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581332.950305:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581332.950326:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220c0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950394:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950408:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950438:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950453:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950461:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950467:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950569:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950577:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950584:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581332.950604:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788581332.950677:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950685:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950691:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950697:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581332.950707:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950715:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950727:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581332.950730:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581332.950734:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950740:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3021d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950751:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950757:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950762:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950767:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581332.950769:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950775:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950782:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581332.950784:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581332.950794:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950799:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950837:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 23 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950850:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 22 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.950858:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581332.950860:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581332.950863:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70800, rc 0) 00000100:00100000:0.0:1788581332.950915:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11291:x1875463170475264:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 632us (826us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788581332.950921:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:3.0:1788581332.960775:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581332.960871:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170475392 00000100:00100000:0.0:1788581332.960880:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170475392 00000100:00100000:0.0:1788581332.960941:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:0.0:1788581332.960952:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11291:x1875463170475392:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581332.961018:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961048:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961061:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961112:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961120:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961127:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961133:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581332.961137:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961145:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961158:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581332.961161:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581332.961165:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581332.961171:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30239 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581332.961300:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11291:x1875463170475392:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 348us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581332.961309:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:3.0:1788581332.965373:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581332.965699:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170475648 00000100:00100000:2.0:1788581332.965709:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170475648 00000100:00100000:2.0:1788581332.965798:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581332.965810:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11291:x1875463170475648:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581332.966059:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:11291:x1875463170475648:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 250us (692us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788581332.966068:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581333.014397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581333.016147:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170475904 00000100:00100000:1.0:1788581333.016161:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170475904 00000100:00100000:0.0:1788581333.016882:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:0.0:1788581333.016896:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:10817:x1875463170475904:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581333.016934:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581333.016964:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30240 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220c7 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.017080:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.017096:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 24 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.017105:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.017136:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 24 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.017149:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 24 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.017164:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184181760:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581333.017334:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.021999:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.023017:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476032 00000100:00100000:2.0:1788581333.023028:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476032 00010000:00010000:2.0:1788581333.023073:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 25 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.023169:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:2.0:1788581333.023181:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:2396:x1875463170476032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581333.023210:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581333.023218:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 25 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.023231:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 25 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.023290:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.023296:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.023308:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.023315:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.023352:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581333.023404:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:2396:x1875463170476032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 225us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581333.023412:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00010000:00010000:0.0:1788581333.025918:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3022b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c0 expref: 24 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.025949:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184181760:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581333.025978:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.026011:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.026018:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581333.026039:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788581333.026172:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30240 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 25 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.026197:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 24 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.026207:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581333.026415:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788581333.026420:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70e00, rc 0) 00000100:00100000:0.0:1788581333.026490:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:10817:x1875463170475904:12345-192.168.203.3@tcp:101:bash.0 Request processed in 9597us (12101us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788581333.026499:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:0.0:1788581333.034778:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.035015:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476160 00000100:00100000:2.0:1788581333.035024:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476160 00000100:00100000:2.0:1788581333.035115:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:2.0:1788581333.035125:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:10817:x1875463170476160:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581333.035148:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581333.035168:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30255 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220ce expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035217:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3025c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035230:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3025c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035242:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3025c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035392:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30255 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ce expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035410:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3025c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ce expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.035419:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.035430:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581333.035434:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:2.0:1788581333.035545:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:10817:x1875463170476160:12345-192.168.203.3@tcp:101:bash.0 Request processed in 421us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581333.035552:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:1.0:1788581333.043241:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.043870:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476416 00000100:00100000:2.0:1788581333.043879:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476416 00000100:00100000:2.0:1788581333.043932:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:2.0:1788581333.043939:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:10817:x1875463170476416:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:2.0:1788581333.044150:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.044165:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.044177:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581333.044233:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788581333.044277:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000364ef79f reply state 000000009a05c7a9 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.044289:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.044296:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.044299:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581333.044303:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788581333.044386:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788581333.044670:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:10817:x1875463170476416:12345-192.168.203.3@tcp:36:bash.0 Request processed in 728us (1437us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788581333.044686:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000020:00080000:2.0:1788581333.044691:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788581333.049691:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.049888:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476544 00000100:00100000:0.0:1788581333.049897:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476544 00000100:00100000:0.0:1788581333.049952:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:0.0:1788581333.049963:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:10817:x1875463170476544:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581333.049985:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581333.050003:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3026a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220d5 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.050073:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3026a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220d5 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.050087:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3026a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220d5 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.050105:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581333.050108:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581333.050111:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70800, rc 0) 00000100:00100000:0.0:1788581333.050166:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:10817:x1875463170476544:12345-192.168.203.3@tcp:101:bash.0 Request processed in 205us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581333.050174:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:0.0:1788581333.054337:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.054479:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476672 00000100:00100000:3.0:1788581333.054489:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476672 00000100:00100000:3.0:1788581333.054538:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1788581333.054547:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:10817:x1875463170476672:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581333.054564:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581333.054583:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220dc expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581333.054621:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b95d3, atime: 0x6a9b95d1, ctime: 0x6a9b95d3, blocks: 0x8 00010000:00010000:3.0:1788581333.054643:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1788581333.054648:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.054655:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.054673:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.054716:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980200, rc 0) 00000100:00100000:3.0:1788581333.054782:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:10817:x1875463170476672:12345-192.168.203.3@tcp:101:bash.0 Request processed in 235us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.054789:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:1.0:1788581333.064536:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.068297:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476800 00000100:00100000:0.0:1788581333.068312:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476800 00002000:00010000:0.0:1788581333.068363:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788581333.068368:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4339c380 with x1875463170476800 ext(0->18446744073709551615) 00002000:00010000:0.0:1788581333.068379:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d4339c380. 00000100:00100000:0.0:1788581333.068421:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1788581333.068431:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170476800:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:0.0:1788581333.068688:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788581333.068692:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788581331 -> 1788581333 00002000:00010000:0.0:1788581333.068694:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788581329 -> 1788581329 00002000:00010000:0.0:1788581333.068697:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788581331 -> 1788581333 00002000:00010000:0.0:1788581333.068699:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788581333.068777:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170476800:12345-192.168.203.3@tcp:10:bash.0 Request processed in 347us (4248us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788581333.068786:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00010000:0.0:1788581333.068789:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788581333.068793:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4339c380 with x1875463170476800 ext(0->18446744073709551615) 00002000:00010000:0.0:1788581333.068798:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d4339c380. 00000100:00100000:2.0:1788581333.142892:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.143414:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170476928 00000100:00100000:0.0:1788581333.143425:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170476928 00000100:00100000:2.0:1788581333.150891:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:2.0:1788581333.150906:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11305:x1875463170476928:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1788581333.150980:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.150997:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151008:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151022:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151030:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151036:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151110:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151119:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151126:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581333.151206:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151218:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151224:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151231:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151237:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.151241:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151248:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151281:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581333.151284:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.151289:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151296:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151308:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151315:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151327:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151332:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.151335:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151342:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151350:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d42038500) 00010000:00010000:2.0:1788581333.151353:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.151356:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151361:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3027f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151375:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151382:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151387:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151392:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.151395:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151410:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151419:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.151421:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.151424:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.151429:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.151514:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11305:x1875463170476928:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 611us (8631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581333.151523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:1.0:1788581333.229340:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.229418:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170477184 00000100:00100000:2.0:1788581333.229428:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170477184 00000100:00100000:2.0:1788581333.229490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:2.0:1788581333.229501:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11308:x1875463170477184:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581333.229530:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581333.229549:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3028d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220e3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229621:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229636:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229649:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229674:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229681:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229688:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229794:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b302a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229805:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b302a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229812:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b302a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581333.229822:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788581333.229896:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229903:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229910:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229916:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.229920:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229938:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229949:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581333.229952:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.229957:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229963:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30294 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229975:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229982:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229987:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.229992:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.229995:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230001:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230007:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d42038500) 00010000:00010000:2.0:1788581333.230010:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.230012:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230027:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b3029b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230065:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3028d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220e3 expref: 33 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230079:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b302a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220e3 expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.230086:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.230089:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788581333.230091:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581333.230166:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11308:x1875463170477184:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 667us (835us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788581333.230173:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:1.0:1788581333.234654:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.234781:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170477312 00000100:00100000:2.0:1788581333.234790:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170477312 00000100:00100000:2.0:1788581333.234851:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:2.0:1788581333.234863:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11308:x1875463170477312:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1788581333.234926:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.234942:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 32 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.234952:0:11562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.235003:0:11562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 32 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.235016:0:11562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 32 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.235032:0:11562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184181888:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581333.235139:0:11562:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e431a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.238672:0:11562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184181888:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581333.238700:0:11562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581333.242316:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.242583:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170477568 00000100:00100000:0.0:1788581333.242594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170477568 00000100:00100000:0.0:1788581333.242663:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:0.0:1788581333.242674:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:10755:x1875463170477568:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788581333.242961:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:10755:x1875463170477568:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 287us (652us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788581333.242968:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1788581333.246026:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.246102:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170477696 00000100:00100000:3.0:1788581333.246111:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170477696 00010000:00010000:3.0:1788581333.246158:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 34 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.246205:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1788581333.246215:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:2395:x1875463170477696:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581333.246227:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581333.246234:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 34 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246248:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 34 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246318:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30247 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220c7 expref: 34 pid: 9504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246348:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:3.0:1788581333.246354:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246363:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246371:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.246414:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581333.246467:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:2395:x1875463170477696:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 254us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.246474:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00010000:00010000:2.0:1788581333.246563:0:11562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246574:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246612:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246619:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246626:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246632:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.246636:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246644:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246667:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.246670:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581333.246675:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.246681:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.246743:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11308:x1875463170477312:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 11882us (12096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581333.246751:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:1.0:1788581333.249466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.249720:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170477952 00000100:00100000:2.0:1788581333.249731:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170477952 00000100:00100000:2.0:1788581333.249789:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1788581333.249800:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:11308:x1875463170477952:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581333.250015:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:11308:x1875463170477952:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 215us (556us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788581333.250023:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1788581333.320593:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184182016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581333.320674:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581333.320978:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184182016 00000100:00100000:2.0:1788581333.320986:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184182016 00000100:00100000:2.0:1788581333.321045:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788581333.321056:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184182016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581333.321089:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788581333.321147:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184182016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581333.321154:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788581333.326080:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184182016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581333.365860:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.366068:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170478208 00000100:00100000:2.0:1788581333.366079:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170478208 00000100:00100000:2.0:1788581333.366147:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:2.0:1788581333.366158:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+33:11319:x1875463170478208:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1788581333.366191:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581333.366210:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220ea expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366312:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366327:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366337:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366351:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366357:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366364:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366685:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b302cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366695:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b302cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366719:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b302cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581333.366729:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788581333.366803:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366811:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366817:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366834:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.366838:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366846:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366857:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581333.366860:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.366864:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366869:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366882:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.366887:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367031:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367035:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.367039:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367044:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367052:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d42038500) 00010000:00010000:2.0:1788581333.367055:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.367057:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367062:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367106:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b302b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ea expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367119:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b302cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ea expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.367126:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:2.0:1788581333.367128:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581333.367131:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272400, rc 0) 00000100:00100000:2.0:1788581333.367295:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11319:x1875463170478208:12345-192.168.203.3@tcp:101:cat.0 Request processed in 1139us (1443us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788581333.367313:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:1.0:1788581333.385405:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.385565:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170478464 00000100:00100000:0.0:1788581333.385574:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170478464 00000100:00100000:0.0:1788581333.385634:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581333.385645:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11319:x1875463170478464:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:0.0:1788581333.385946:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:11319:x1875463170478464:12345-192.168.203.3@tcp:35:cat.0 Request processed in 302us (549us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788581333.385955:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581333.410477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.410630:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170478720 00000100:00100000:0.0:1788581333.410640:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170478720 00000100:00100000:0.0:1788581333.410739:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:0.0:1788581333.410750:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:11320:x1875463170478720:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1788581333.410823:0:9504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788581333.410848:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b3026a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220d5 expref: 36 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410869:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b302cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ea expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410881:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b302a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220e3 expref: 34 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410893:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3025c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ce expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410902:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581333.410907:0:9504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581333.410928:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410940:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410948:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410961:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410967:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.410984:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411055:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411063:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411069:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581333.411302:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:0.0:1788581333.411349:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411359:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411366:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411373:0:9504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411379:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411385:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411409:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581333.411549:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411556:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411563:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411568:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.411572:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411580:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411589:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581333.411592:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788581333.411596:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411602:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b302e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411615:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411621:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411627:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411632:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.411640:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411647:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411655:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581333.411657:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581333.411660:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411666:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b302da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581333.411676:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888221f0 reply state 0000000082064257 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411686:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.411692:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581333.411695:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581333.411697:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581333.411776:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:11320:x1875463170478720:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1026us (1306us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788581333.411783:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00010000:00010000:1.0:1788581333.411847:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581333.411853:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.411859:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581333.411862:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.411868:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.411877:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:1.0:1788581333.411879:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581333.411881:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.411886:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b302ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.411894:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581333.411896:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581333.411903:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581333.491106:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.491300:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170478976 00000100:00100000:2.0:1788581333.491309:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170478976 00000100:00100000:2.0:1788581333.491373:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:2.0:1788581333.491384:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:11326:x1875463170478976:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581333.491408:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581333.491428:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220f1 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491527:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491541:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491552:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491564:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491571:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.491653:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581333.491961:0:11562:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788581333.492060:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492072:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492077:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492101:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492106:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492111:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492406:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.492412:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492420:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492432:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581333.492435:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581333.492440:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492446:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b302fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581333.492458:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5be5800 reply state 00000000f3c84c5d transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492477:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492484:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:2.0:1788581333.492486:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581333.492489:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788581333.492723:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b302f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 37 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492738:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 36 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.492745:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:2.0:1788581333.492748:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581333.492750:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581333.492861:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:11326:x1875463170478976:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1478us (1765us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788581333.492869:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:2.0:1788581333.497936:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.498529:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170479104 00000100:00100000:3.0:1788581333.498539:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170479104 00000100:00100000:3.0:1788581333.498666:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581333.498676:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2394:x1875463170479104:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581333.498693:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581333.498712:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220f8 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581333.498737:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581333.498754:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1788581333.498759:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.498768:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.498809:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.498822:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581333.498873:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2394:x1875463170479104:12345-192.168.203.3@tcp:101:bash.0 Request processed in 200us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.498880:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00080000:1.0:1788581333.502021:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581333.507491:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.507747:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170479232 00000100:00100000:3.0:1788581333.507757:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170479232 00000100:00100000:3.0:1788581333.507814:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1788581333.507826:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:11326:x1875463170479232:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581333.507843:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581333.507861:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df220ff expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.507890:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.507898:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.507902:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.507907:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.507939:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.507972:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.507985:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184182144:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581333.508151:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a41240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.514080:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184182144:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581333.514115:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.514135:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980600, rc 0) 00000100:00100000:3.0:1788581333.514196:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:11326:x1875463170479232:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6372us (6714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.514204:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1788581333.514689:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.515057:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170479360 00000100:00100000:3.0:1788581333.515064:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170479360 00010000:00010000:3.0:1788581333.515094:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.515129:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1788581333.515138:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170479360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581333.515148:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581333.515166:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.515212:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.515235:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b30319 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f8 expref: 9 pid: 8408 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.515249:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.515304:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.515312:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.515322:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.515352:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.515366:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875463184182272:192.168.203.3@tcp:105: 00000100:00100000:3.0:1788581333.515527:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a41240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.525528:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875463184182272:192.168.203.3@tcp:105: 00010000:00010000:3.0:1788581333.525557:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581333.525665:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170479360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 10526us (10985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.525677:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1788581333.534061:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.534155:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170479616 00000100:00100000:2.0:1788581333.534165:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170479616 00000100:00100000:2.0:1788581333.534222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1788581333.534232:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:11326:x1875463170479616:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1788581333.534539:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11326:x1875463170479616:12345-192.168.203.3@tcp:35:bash.0 Request processed in 307us (486us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788581333.534564:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00010000:00010000:1.0:1788581333.697527:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581333.709525:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581333.709635:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170479744 00000100:00100000:1.0:1788581333.709645:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170479744 00000100:00100000:1.0:1788581333.709702:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:1.0:1788581333.709716:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:11342:x1875463170479744:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581333.709742:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581333.709763:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22106 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709824:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709837:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709849:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581333.709895:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788581333.709900:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581333.709917:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709939:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22106 expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709976:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22106 expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.709985:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581333.709987:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581333.709990:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581333.710055:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:11342:x1875463170479744:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 345us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581333.710062:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:0.0:1788581333.714794:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581333.714952:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480000 00000100:00100000:1.0:1788581333.714962:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480000 00000100:00100000:1.0:1788581333.715020:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:1.0:1788581333.715031:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:11342:x1875463170480000:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581333.715050:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581333.715071:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2210d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.715190:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3033c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.715206:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3033c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.715217:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3033c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581333.715227:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788581333.715861:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2210d expref: 42 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.715881:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3033c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2210d expref: 41 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.715889:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:1.0:1788581333.715892:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581333.715895:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:1.0:1788581333.716001:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:11342:x1875463170480000:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 971us (1215us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788581333.716009:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:2.0:1788581333.725067:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.725163:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480384 00000100:00100000:0.0:1788581333.725174:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480384 00000100:00100000:0.0:1788581333.725376:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581333.725388:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:2396:x1875463170480384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581333.725429:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581333.725452:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3033c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2210d expref: 41 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.725469:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:0.0:1788581333.725474:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581333.725522:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:2396:x1875463170480384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 137us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581333.725529:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1788581333.729489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.729823:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480256 00000100:00100000:3.0:1788581333.729834:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480256 00000100:00100000:3.0:1788581333.729888:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:3.0:1788581333.729898:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:11342:x1875463170480256:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581333.729921:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581333.729940:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3034a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22114 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.730040:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.730055:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.730067:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581333.730079:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788581333.730194:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3034a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22114 expref: 43 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.730211:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22114 expref: 42 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.730220:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:3.0:1788581333.730222:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788581333.730226:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:3.0:1788581333.730606:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:11342:x1875463170480256:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 698us (1307us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788581333.730635:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:1.0:1788581333.739514:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.739853:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480512 00000100:00100000:3.0:1788581333.739862:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480512 00000100:00100000:3.0:1788581333.739922:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:3.0:1788581333.739933:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170480512:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:3.0:1788581333.739977:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.739998:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.740007:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581333.740011:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581333.740016:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.740053:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.740066:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 8 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.740082:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184182400:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581333.740191:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.743145:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184182400:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581333.743197:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581333.745915:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.746231:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480640 00000100:00100000:0.0:1788581333.746240:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480640 00002000:00100000:0.0:1788581333.746329:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff995d4384ca80 x1875463170480640/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:689/0 lens 504/0 e 0 to 0 dl 1788581344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581333.746340:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4384ca80 with x1875463170480640 ext(0->8) 00010000:00010000:0.0:1788581333.746349:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 9 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.746364:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 9 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581333.746371:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d4384ca80 00000100:00100000:0.0:1788581333.746399:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1788581333.746418:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170480640:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:0.0:1788581333.748167:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2395:x1875463170480640:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 1752us (2252us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788581333.748207:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00100000:0.0:1788581333.748218:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff995d4384ca80 x1875463170480640/t4294967303(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:689/0 lens 504/448 e 0 to 0 dl 1788581344 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581333.748227:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4384ca80 with x1875463170480640 ext(0->8) 00010000:00010000:0.0:1788581333.748235:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.748349:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581333.748359:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d4384ca80 00000100:00100000:2.0:1788581333.752937:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.753028:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170480768 00000100:00100000:0.0:1788581333.753038:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170480768 00010000:00010000:0.0:1788581333.753076:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.753116:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:0.0:1788581333.753125:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e5338c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2394:x1875463170480768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581333.753142:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788581333.753157:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788581333.753160:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788581333 00002000:00010000:0.0:1788581333.753162:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788581333 00002000:00010000:0.0:1788581333.753164:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788581333 00002000:00010000:0.0:1788581333.753166:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788581333.753171:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.753211:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.753231:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b30320 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df220ff expref: 11 pid: 8906 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.753248:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581333.753305:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581333.753316:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.753326:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.753354:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581333.753402:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e5338c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2394:x1875463170480768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 279us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581333.753421:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:1.0:1788581333.753951:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.753963:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.753982:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.753989:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.753996:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.754012:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581333.754016:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.754025:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.754038:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.754045:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c4856f/0x50f0cc74b7b3035f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581333.754115:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170480512:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 14183us (14609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581333.754123:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1788581333.759373:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.759525:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481024 00000100:00100000:0.0:1788581333.759534:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481024 00000100:00100000:0.0:1788581333.759594:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1788581333.759761:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:11342:x1875463170481024:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:0.0:1788581333.759822:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22114 expref: 42 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581333.760058:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788581333.760095:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788581333.761002:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788581333.761048:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.761066:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 46 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.761075:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.761111:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 46 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.761126:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 46 pid: 11562 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.761142:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875463184182528:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581333.761306:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581333.765588:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6496:1875463184182528:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581333.765632:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.766461:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.766712:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481152 00000100:00100000:3.0:1788581333.766720:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481152 00010000:00010000:3.0:1788581333.766758:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 47 pid: 11562 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581333.766795:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1788581333.766804:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:2396:x1875463170481152:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581333.766817:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581333.766825:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 47 pid: 11562 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766838:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 47 pid: 11562 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766859:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3030b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df220f1 expref: 47 pid: 11562 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766874:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:3.0:1788581333.766879:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766889:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766896:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.766936:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581333.766989:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+46:2396:x1875463170481152:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 186us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.766996:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00010000:00010000:2.0:1788581333.767804:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.767815:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581333.767926:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788581333.768038:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788581333.768138:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875463184182656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788581333.768204:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581333.768237:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581333.768792:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184182656 00000100:00100000:3.0:1788581333.768801:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184182656 00000100:00100000:3.0:1788581333.768868:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788581333.768878:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6496:x1875463184182656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788581333.768975:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6496:x1875463184182656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.768982:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788581333.769066:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875463184182656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788581333.769201:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788581333.769248:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875463184182784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788581333.769309:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581333.769327:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581333.769489:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184182784 00000100:00100000:2.0:1788581333.769494:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184182784 00000100:00100000:2.0:1788581333.769527:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788581333.769534:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6496:x1875463184182784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788581333.769791:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6496:x1875463184182784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 258us (481us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788581333.769804:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788581333.769834:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6496:1875463184182784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788581333.769866:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788581333.769894:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769904:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769911:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769916:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581333.769920:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769927:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769942:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:2.0:1788581333.769944:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788581333.769948:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581333.769954:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30366 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581333.770029:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788581333.770081:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788581333.770091:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319911836712ns, next at 320911834501ns, rc = 0 00000001:00080000:2.0:1788581333.770103:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788581333.770123:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995d42038500) 00010000:00010000:2.0:1788581333.770126:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788581333.770132:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30351 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22114 expref: 50 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581333.770222:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:11342:x1875463170481024:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 10613us (10859us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788581333.770230:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000020:00080000:2.0:1788581333.770234:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788581333.770949:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581333.782018:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581333.782102:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481280 00000100:00100000:3.0:1788581333.782112:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481280 00000100:00100000:3.0:1788581333.782169:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1788581333.782190:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:11342:x1875463170481280:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581333.782213:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581333.782235:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3036d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2211b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.782339:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3036d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2211b expref: 50 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.782354:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3036d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2211b expref: 50 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581333.782371:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581333.782388:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581333.782392:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581333.782509:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:11342:x1875463170481280:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 331us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581333.782516:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1788581333.788858:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.788970:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481536 00000100:00100000:2.0:1788581333.788979:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481536 00000100:00100000:2.0:1788581333.789029:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581333.789040:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:11342:x1875463170481536:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581333.789320:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:11342:x1875463170481536:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 282us (469us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788581333.789328:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581333.890958:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.893691:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481664 00000100:00100000:0.0:1788581333.893706:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481664 00000100:00100000:0.0:1788581333.893801:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:0.0:1788581333.893813:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:11352:x1875463170481664:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1788581333.893897:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.893913:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.893926:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.893936:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.893943:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.893948:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894018:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894027:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894034:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581333.894081:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894093:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894106:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894113:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894119:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.894123:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894130:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894141:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581333.894144:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581333.894148:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894154:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894166:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894172:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894187:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894192:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.894202:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894208:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894216:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581333.894218:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581333.894221:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894227:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3037b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894236:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894248:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894307:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894314:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.894318:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894324:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894332:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581333.894334:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581333.894344:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.894361:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.894439:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:11352:x1875463170481664:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 628us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581333.894447:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:3.0:1788581333.943439:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581333.944019:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170481920 00000100:00100000:1.0:1788581333.944029:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170481920 00000100:00100000:1.0:1788581333.944083:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1788581333.944092:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:11355:x1875463170481920:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581333.944112:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581333.944130:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22122 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944225:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944240:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944251:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944310:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944318:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944325:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944420:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3039e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944428:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3039e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944435:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3039e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581333.944443:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788581333.944504:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944511:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944523:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944529:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581333.944533:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944540:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944551:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581333.944554:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581333.944558:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944564:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944577:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944583:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944588:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944610:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581333.944613:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944628:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944636:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:1.0:1788581333.944638:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581333.944641:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944647:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30397 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944678:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22122 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944690:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3039e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22122 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581333.944697:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581333.944699:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581333.944702:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581333.944755:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11355:x1875463170481920:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 664us (1325us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788581333.944762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1788581333.950012:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581333.950098:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170482048 00000100:00100000:0.0:1788581333.950107:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170482048 00000100:00100000:0.0:1788581333.950167:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:0.0:1788581333.950187:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11355:x1875463170482048:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581333.950251:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950299:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950310:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950342:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950349:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950364:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950371:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581333.950387:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950394:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950407:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581333.950410:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581333.950414:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581333.950420:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b303ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581333.950485:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11355:x1875463170482048:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 308us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581333.950492:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:0.0:1788581333.954379:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581333.954459:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170482304 00000100:00100000:2.0:1788581333.954469:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170482304 00000100:00100000:2.0:1788581333.954518:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1788581333.954529:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:11355:x1875463170482304:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581333.954762:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11355:x1875463170482304:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 233us (390us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788581333.954770:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581334.055395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.060358:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170482560 00000100:00100000:2.0:1788581334.060372:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170482560 00000100:00080000:1.0:1788581334.060556:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581334.061631:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:2.0:1788581334.061646:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11365:x1875463170482560:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581334.061672:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581334.061676:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788581334.061704:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3032e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22106 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.061736:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581334.061741:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581334.061753:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b303b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22129 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.061852:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.061865:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.061876:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581334.061886:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788581334.061995:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b303b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22129 expref: 56 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.062010:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22129 expref: 55 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.062017:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.062030:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581334.062034:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:2.0:1788581334.062107:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:11365:x1875463170482560:12345-192.168.203.3@tcp:101:bash.0 Request processed in 466us (6721us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788581334.062114:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1788581334.069589:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.069646:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.069716:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170482688 00000100:00100000:2.0:1788581334.069736:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170482688 00000100:00100000:2.0:1788581334.069804:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581334.069815:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:2394:x1875463170482688:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581334.069829:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581334.069853:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22129 expref: 55 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.069873:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.069878:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581334.069938:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:2394:x1875463170482688:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.069945:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1788581334.071093:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170482816 00000100:00100000:3.0:1788581334.071103:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170482816 00000100:00100000:3.0:1788581334.071156:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:3.0:1788581334.071165:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:11365:x1875463170482816:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581334.072231:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581334.072864:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b303c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22130 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.072911:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.073558:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.074854:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.076073:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b303c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 56 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.076099:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.076123:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581334.076125:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581334.076128:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980a00, rc 0) 00000100:00100000:3.0:1788581334.076211:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:11365:x1875463170482816:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5045us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.076220:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:1.0:1788581334.082195:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.082434:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483072 00000100:00100000:0.0:1788581334.082443:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483072 00000100:00100000:0.0:1788581334.082503:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:0.0:1788581334.082513:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:11365:x1875463170483072:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1788581334.082574:0:9504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581334.082602:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3039e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22122 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.082630:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.082635:0:9504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581334.084466:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.084500:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.084512:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581334.084567:0:9504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1788581334.084592:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005af5cd9f reply state 000000003cb689f0 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.084618:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.084626:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.084629:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581334.084633:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581334.085890:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11365:x1875463170483072:12345-192.168.203.3@tcp:36:bash.0 Request processed in 3369us (3706us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788581334.085901:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000020:00080000:0.0:1788581334.085907:0:9504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788581334.088834:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.090296:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483200 00000100:00100000:2.0:1788581334.090308:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483200 00000100:00100000:2.0:1788581334.090384:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1788581334.090394:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:11365:x1875463170483200:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581334.090416:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581334.090433:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b303dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22137 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.090512:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.090537:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.090548:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581334.090586:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788581334.090590:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581334.091880:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.091986:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b303dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 59 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.092004:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 58 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.092013:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.092016:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581334.092019:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:2.0:1788581334.092152:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:11365:x1875463170483200:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1758us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.092160:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1788581334.099284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.099515:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483456 00000100:00100000:3.0:1788581334.099526:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483456 00000100:00100000:3.0:1788581334.099592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1788581334.099603:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:11365:x1875463170483456:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1788581334.099820:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:11365:x1875463170483456:12345-192.168.203.3@tcp:35:bash.0 Request processed in 218us (576us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788581334.099828:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1788581334.167956:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.168043:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483584 00000100:00100000:3.0:1788581334.168053:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483584 00000100:00100000:3.0:1788581334.168114:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1788581334.168126:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:11371:x1875463170483584:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581334.168149:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581334.168169:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b303eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2213e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168244:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168311:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168337:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581334.168392:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788581334.168396:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581334.168414:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168443:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b303eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2213e expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168461:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2213e expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.168469:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581334.168472:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581334.168475:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980400, rc 0) 00000100:00100000:3.0:1788581334.168537:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170483584:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 414us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.168543:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:1.0:1788581334.184966:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.185127:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483712 00000100:00100000:0.0:1788581334.185138:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483712 00000100:00100000:0.0:1788581334.185208:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:0.0:1788581334.185218:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170483712:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581334.185236:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581334.185282:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b303f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22145 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185365:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185392:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185405:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185417:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185425:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185432:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185502:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185511:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185519:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581334.185560:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788581334.185564:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581334.185582:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185604:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185613:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185620:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185627:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185633:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.185636:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185644:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185655:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581334.185658:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.185662:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185668:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185680:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185687:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185698:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185703:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.185706:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185712:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185720:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581334.185723:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.185726:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185731:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185754:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b303f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185766:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 61 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.185773:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.185775:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581334.185777:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71400, rc 0) 00000100:00100000:0.0:1788581334.185835:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11371:x1875463170483712:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 618us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.185850:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:2.0:1788581334.193990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.194034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.194590:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484096 00000100:00100000:1.0:1788581334.194600:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484096 00000100:00100000:1.0:1788581334.194671:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1788581334.194681:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11371:x1875463170484096:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581334.194701:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581334.194720:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30415 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2214c expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194822:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194837:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 62 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194846:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194854:0:11562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194884:0:11562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.194896:0:11562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.194909:0:11562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184182912:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581334.195019:0:11562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 62 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.195029:0:11562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 62 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.195037:0:11562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184183040:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581334.195059:0:11562:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581334.195685:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170483840 00000100:00100000:3.0:1788581334.195693:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170483840 00010000:00010000:3.0:1788581334.195718:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 63 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581334.195754:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1788581334.195762:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:2396:x1875463170483840:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581334.195784:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.195791:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 63 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.195803:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 63 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.195821:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581334.195825:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.195832:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.195838:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581334.195877:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:2396:x1875463170483840:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 116us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.195884:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1788581334.203646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.203754:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484224 00000100:00100000:0.0:1788581334.203763:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484224 00010000:00010000:0.0:1788581334.203803:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 63 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.203848:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:0.0:1788581334.203859:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:2396:x1875463170484224:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581334.203873:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581334.203880:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 63 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.203894:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 63 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.203916:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.203921:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.203931:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.203938:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.203956:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581334.204021:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:2396:x1875463170484224:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 164us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.204052:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00010000:00010000:1.0:1788581334.204708:0:11562:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.3@tcp) returned -22 from blocking AST (req@000000009731371c x1875463184182912) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.204726:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b3040e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22145 expref: 62 pid: 9504 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.204742:0:11562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184182912:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581334.204757:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b303e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22137 expref: 61 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.204766:0:11562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184183040:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581334.204784:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581334.204790:0:11562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.204799:0:11562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.204818:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581334.204835:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788581334.204957:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 62 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.204971:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 61 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.204978:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581334.204981:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581334.204983:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:1.0:1788581334.205187:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11371:x1875463170484096:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 10497us (11141us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788581334.205195:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:2.0:1788581334.211602:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.211840:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484480 00000100:00100000:3.0:1788581334.211850:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484480 00000100:00100000:3.0:1788581334.211969:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581334.211980:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11371:x1875463170484480:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:3.0:1788581334.211996:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.212020:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b3036d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2211b expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.212039:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581334.212044:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581334.212106:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170484480:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 127us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.212114:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581334.215028:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.215907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484608 00000100:00100000:1.0:1788581334.215918:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484608 00000100:00100000:1.0:1788581334.216021:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1788581334.216032:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170484608:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:1.0:1788581334.216137:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.216153:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.216165:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581334.216326:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788581334.216408:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170484608:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 377us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.216415:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1788581334.219226:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.219990:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484736 00000100:00100000:0.0:1788581334.220001:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484736 00000100:00100000:1.0:1788581334.220065:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1788581334.220077:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:11371:x1875463170484736:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581334.220095:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581334.220112:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22153 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220166:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220190:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220210:0:6493:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220223:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220236:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581334.220239:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581334.220243:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.220307:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a800, rc 0) 00000100:00100000:1.0:1788581334.220363:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11371:x1875463170484736:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 289us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.220370:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000040:00080000:1.0:1788581334.657482:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581334.657491:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581334.657529:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788581334.657537:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581334.657668:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184183168:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581334.657771:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.665796:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.665915:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184183168:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581334.666069:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484864 00000100:00100000:3.0:1788581334.666076:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484864 00000100:00100000:3.0:1788581334.666138:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1788581334.666148:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11372:x1875463170484864:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581334.666190:0:11562:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581334.666952:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11372:x1875463170484864:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 801us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.666961:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:2.0:1788581334.671576:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.671677:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170484992 00000100:00100000:0.0:1788581334.671687:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170484992 00000100:00100000:0.0:1788581334.671759:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:0.0:1788581334.671769:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11372:x1875463170484992:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788581334.671836:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671853:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671864:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671879:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671885:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671892:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671912:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671922:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.671947:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581334.671991:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788581334.671994:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581334.672005:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672015:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672020:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672026:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672031:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.672035:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672042:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672052:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:0.0:1788581334.672055:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.672059:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672064:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30438 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672087:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672092:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672098:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672101:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.672104:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672109:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672116:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff995d4233d300) 00010000:00010000:0.0:1788581334.672118:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.672120:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672126:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3043f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672139:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672144:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672149:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672158:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.672161:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672166:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672185:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.672187:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.672190:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.672196:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b30446 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.672785:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11372:x1875463170484992:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 1014us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.672794:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1788581334.680243:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.680573:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170485248 00000100:00100000:1.0:1788581334.680583:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170485248 00000100:00100000:1.0:1788581334.680653:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:1.0:1788581334.680664:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:11372:x1875463170485248:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581334.680684:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581334.680702:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3044d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2215a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681100:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681117:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681129:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581334.681150:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788581334.681230:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681238:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681244:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.681250:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.681278:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682100:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682120:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581334.682123:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788581334.682128:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682135:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682193:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3044d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2215a expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682579:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:1.0:1788581334.682582:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581334.682671:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3044d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2215a expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.682685:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581334.682853:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170485248:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2188us (2616us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788581334.682861:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:2.0:1788581334.689511:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.689730:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170485376 00000100:00100000:3.0:1788581334.689739:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170485376 00000100:00100000:3.0:1788581334.689830:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:3.0:1788581334.689840:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170485376:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581334.689877:0:11562:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581334.689994:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170485376:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 155us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.690002:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1788581334.696947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.696972:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170485632 00000100:00100000:0.0:1788581334.697037:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170485632 00000100:00100000:0.0:1788581334.697157:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1788581334.697170:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170485632:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581334.697216:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581334.697220:0:9504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788581334.697246:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b303f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2213e expref: 62 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697281:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581334.697299:0:9504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581334.697314:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30462 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22161 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581334.697709:0:9504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788581334.697865:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697878:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697888:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697939:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30462 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22161 expref: 64 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697954:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22161 expref: 63 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.697961:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995d4233d300) 00010000:00010000:0.0:1788581334.697965:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581334.697967:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581334.698043:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:11372:x1875463170485632:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 876us (1105us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788581334.698050:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1788581334.702700:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.702830:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170485888 00000100:00100000:1.0:1788581334.702841:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170485888 00000100:00100000:1.0:1788581334.702898:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:1.0:1788581334.702908:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:11372:x1875463170485888:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581334.702961:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581334.702996:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22161 expref: 63 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703015:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995d4233d300) 00010000:00010000:1.0:1788581334.703025:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581334.703046:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703058:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703068:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703132:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703157:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703164:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703225:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703232:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703239:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703244:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.703249:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703277:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703285:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581334.703288:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581334.703291:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703297:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30477 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703308:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703320:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703326:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703331:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.703333:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703339:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703347:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe553bfa9 (ffff995e7a659500) 00010000:00010000:1.0:1788581334.703350:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581334.703353:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.703358:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3047e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe553bfa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.703751:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170485888:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 842us (1058us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581334.703759:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:2.0:1788581334.707748:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.707999:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170486016 00000100:00100000:3.0:1788581334.708011:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170486016 00000100:00100000:3.0:1788581334.708074:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1788581334.708085:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:11372:x1875463170486016:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581334.708104:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581334.708126:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30485 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22168 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708190:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708214:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708226:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708373:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 64 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708392:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 63 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.708401:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:3.0:1788581334.708404:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581334.708407:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981400, rc 0) 00000100:00100000:3.0:1788581334.708470:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:11372:x1875463170486016:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 387us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.708477:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1788581334.713780:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.713869:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170486272 00000100:00100000:0.0:1788581334.713878:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170486272 00000100:00100000:0.0:1788581334.713964:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1788581334.713974:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:11372:x1875463170486272:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581334.714054:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.714070:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.714082:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581334.714244:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788581334.714296:0:9504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320856040818ns, next at 321855997300ns, rc = 0 00000004:00010000:0.0:1788581334.714346:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e77a4a reply state 000000000e5a04cb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.714360:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.714368:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:0.0:1788581334.714372:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788581334.714375:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581334.714475:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:11372:x1875463170486272:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 502us (703us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788581334.714483:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00010000:00010000:1.0:1788581334.721591:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581334.721682:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.721910:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170486400 00000100:00100000:0.0:1788581334.721920:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170486400 00000100:00100000:0.0:1788581334.721976:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1788581334.721987:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:11372:x1875463170486400:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581334.722009:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581334.722041:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2216f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.722100:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.722114:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.722133:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:0.0:1788581334.722136:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581334.722140:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581334.722845:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:11372:x1875463170486400:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 857us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.722851:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:2.0:1788581334.731406:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.731581:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170486528 00000100:00100000:1.0:1788581334.731591:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170486528 00000100:00100000:1.0:1788581334.731708:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:1.0:1788581334.731719:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170486528:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788581334.731961:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170486528:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 242us (573us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788581334.731969:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00080000:2.0:1788581334.732294:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581334.737652:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.737740:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170486784 00000100:00100000:3.0:1788581334.737750:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170486784 00000100:00100000:3.0:1788581334.737808:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581334.737818:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:11372:x1875463170486784:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581334.738029:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:11372:x1875463170486784:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 211us (385us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788581334.738049:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1788581334.744369:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.747421:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487040 00000100:00100000:3.0:1788581334.747437:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487040 00000100:00100000:2.0:1788581334.750804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1788581334.750820:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:11372:x1875463170487040:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581334.750943:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:11372:x1875463170487040:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 126us (6583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.750950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1788581334.760983:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.761477:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487168 00000100:00100000:0.0:1788581334.761487:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487168 00000100:00100000:0.0:1788581334.761610:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:0.0:1788581334.761622:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:11372:x1875463170487168:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581334.761643:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581334.761664:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b304a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22176 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761731:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761745:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761770:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581334.761814:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581334.761832:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761859:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b304a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22176 expref: 69 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761876:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22176 expref: 68 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.761885:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:0.0:1788581334.761887:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581334.761891:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71e00, rc 0) 00000100:00100000:0.0:1788581334.761955:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:11372:x1875463170487168:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 335us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.761961:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:3.0:1788581334.769787:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.769853:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.769885:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.769919:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.769939:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.769967:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487808 00000100:00100000:3.0:1788581334.769976:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487808 00000100:00080000:3.0:1788581334.770001:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581334.770038:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487424 00000100:00100000:3.0:1788581334.770041:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487424 00000100:00080000:3.0:1788581334.770058:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581334.770075:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487680 00000100:00100000:3.0:1788581334.770078:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487680 00000100:00080000:3.0:1788581334.770088:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581334.770104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:3.0:1788581334.770115:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170487808:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581334.770151:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487552 00000100:00100000:2.0:1788581334.770158:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487552 00000100:00100000:2.0:1788581334.770201:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:2.0:1788581334.770211:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170487552:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581334.770223:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487296 00000100:00100000:0.0:1788581334.770229:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487296 00000100:00100000:3.0:1788581334.770241:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170487808:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.770249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:2.0:1788581334.770280:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170487552:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.770283:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 376 00000100:00100000:3.0:1788581334.770288:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:0.0:1788581334.770291:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170487296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581334.770296:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170487424:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581334.770308:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:3.0:1788581334.770331:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170487424:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.770338:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:3.0:1788581334.770364:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00100000:3.0:1788581334.770372:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170487680:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581334.777189:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170487296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 6878us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.777192:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170487680:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 6820us (7251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.777205:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00100000:0.0:1788581334.777280:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 376 00000100:00100000:1.0:1788581334.783711:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.785119:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170487936 00000100:00100000:3.0:1788581334.785132:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170487936 00000100:00100000:3.0:1788581334.785210:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1788581334.785220:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170487936:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581334.785236:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581334.785333:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2217d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581334.785359:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b95d6, blocks: 0x0 00010000:00010000:3.0:1788581334.785382:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1788581334.785387:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581334.785396:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 10 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.785412:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 10 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.785426:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581334.785526:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2395:x1875463170487936:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 306us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.785532:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1788581334.791919:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.792480:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488192 00000100:00100000:1.0:1788581334.792489:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488192 00000100:00100000:1.0:1788581334.792553:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1788581334.792563:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:11372:x1875463170488192:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581334.793711:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:11372:x1875463170488192:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 1145us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.793723:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1788581334.798375:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.798473:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488320 00000100:00100000:2.0:1788581334.798481:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488320 00000100:00100000:2.0:1788581334.798538:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1788581334.798551:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:11372:x1875463170488320:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581334.798582:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581334.798600:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22184 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.798631:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.798640:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581334.798645:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581334.798650:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.798696:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.798709:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.798722:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184183296:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581334.799014:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581334.801824:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184183296:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581334.801867:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.801887:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:0.0:1788581334.802161:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:11372:x1875463170488320:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 3611us (3794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.802170:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1788581334.804395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.804471:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488448 00000100:00100000:0.0:1788581334.804481:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488448 00010000:00010000:0.0:1788581334.804519:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.804559:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:0.0:1788581334.804569:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2396:x1875463170488448:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581334.804583:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581334.804707:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.804722:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.804745:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000441c4b42/0x50f0cc74b7b304af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2217d expref: 11 pid: 8410 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.804761:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581334.804780:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581334.804789:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.804799:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.804837:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.804850:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875463184183424:192.168.203.3@tcp:105: 00000100:00100000:0.0:1788581334.804928:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e96c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581334.808047:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6479:1875463184183424:192.168.203.3@tcp:105: 00010000:00010000:0.0:1788581334.808071:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581334.808118:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2396:x1875463170488448:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3551us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.808128:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581334.813249:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.813970:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488576 00000100:00100000:3.0:1788581334.813982:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488576 00002000:00100000:3.0:1788581334.814032:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff995d439daa00 x1875463170488576/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:690/0 lens 504/0 e 0 to 0 dl 1788581345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581334.814044:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d439daa00 with x1875463170488576 ext(0->12) 00002000:00010000:3.0:1788581334.814050:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d439daa00 00000100:00100000:3.0:1788581334.814087:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1788581334.814097:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2395:x1875463170488576:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788581334.815122:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:2395:x1875463170488576:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 1022us (1877us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788581334.815132:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:3.0:1788581334.815141:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff995d439daa00 x1875463170488576/t4294967309(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:690/0 lens 504/448 e 0 to 0 dl 1788581345 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581334.815150:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d439daa00 with x1875463170488576 ext(0->12) 00002000:00010000:3.0:1788581334.815154:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d439daa00 00000100:00100000:1.0:1788581334.818120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.818221:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488704 00000100:00100000:0.0:1788581334.818231:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488704 00000100:00100000:0.0:1788581334.818318:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1788581334.818329:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:11372:x1875463170488704:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788581334.820186:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788581334.820200:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788581334.820235:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788581334.820274:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e4e96c3c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788581334.820278:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e43fb5c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e4e96cc00 00000020:00080000:1.0:1788581334.820281:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e43fb5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995e6f974e00 00000020:00080000:1.0:1788581334.820323:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e512b1c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788581334.820326:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e42e22800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e512b1000 00000020:00080000:1.0:1788581334.820329:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e42e22c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995e7b282400 00000020:00080000:1.0:1788581334.820361:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788581334.820412:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788581334.820565:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184183680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788581334.820645:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581334.820685:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581334.820693:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184183552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788581334.820727:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581334.820755:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184183680 00000100:00100000:2.0:1788581334.820762:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184183680 00000100:00100000:2.0:1788581334.820805:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184183552 00000100:00100000:2.0:1788581334.820809:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184183552 00000100:00100000:2.0:1788581334.820828:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581334.820836:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184183680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788581334.820936:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788581334.820940:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788581334 00002000:00010000:2.0:1788581334.820942:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788581334.820944:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788581334 -> 1788581334 00002000:00010000:2.0:1788581334.820946:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788581334.820986:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3619:x1875463184183680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (340us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788581334.820993:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581334.821009:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581334.821016:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184183552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788581334.821030:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788581334.821047:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.821066:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.821075:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788581334.821080:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581334.821084:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.821116:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.821130:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 11 pid: 8906 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.821143:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1875463184183808:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581334.821210:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45f00 going to sleep for 11 seconds 00000100:00080000:2.0:1788581334.821227:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788581334.821278:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d439d9880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788581334.821284:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184183680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788581334.821791:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581334.821805:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184183936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788581334.821837:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581334.821914:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184183936 00000100:00100000:3.0:1788581334.821920:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184183936 00000100:00100000:3.0:1788581334.821943:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788581334.821950:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3621:x1875463184183936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788581334.821964:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1788581334.821986:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b95d5, atime: 0x6a9b95d5, ctime: 0x6a9b95d5, blocks: 0x8 00010000:00010000:3.0:1788581334.821993:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.822002:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1788581334.822014:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581334.822020:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.822035:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.822044:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.822051:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.822076:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581334.822204:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3621:x1875463184183936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 253us (365us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788581334.822211:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788581334.822445:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d43a91880/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788581334.822452:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184183936:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788581334.823020:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581334.823028:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.823037:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581334.823042:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.823051:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.823085:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.823092:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b304c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.823111:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581334.823113:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581334.823115:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581334.823467:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11372:x1875463170488704:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 5136us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.823476:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:3.0:1788581334.827325:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1875463184183808:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581334.827351:0:8410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.827940:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.828309:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488832 00000100:00100000:1.0:1788581334.828319:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488832 00010000:00010000:1.0:1788581334.828354:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 12 pid: 8906 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.828394:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:1.0:1788581334.828413:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45351050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:2395:x1875463170488832:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581334.828426:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581334.828432:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 12 pid: 8906 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.828445:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 12 pid: 8906 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.828469:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b30271 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df220dc expref: 12 pid: 8906 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.828485:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581334.828489:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581334.828495:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.828504:0:7444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.828555:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581334.828605:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45351050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2395:x1875463170488832:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 203us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.828613:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00010000:00010000:2.0:1788581334.828855:0:8410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.828865:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.828875:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.828884:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.828919:0:8410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581334.829099:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3619:x1875463184183552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8083us (8370us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788581334.829107:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788581334.829167:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d439d9c00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788581334.829183:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184183552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788581334.829587:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829598:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829629:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829635:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.829640:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829647:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829660:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff995e51befa00) 00010000:00010000:0.0:1788581334.829663:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.829668:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829674:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b301bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829696:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829702:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829707:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829717:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.829720:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829735:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829743:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff995d4233c600) 00010000:00010000:0.0:1788581334.829745:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.829769:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829775:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b30263 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829792:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829798:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829804:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829809:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.829812:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829818:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829825:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581334.829828:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.829831:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829842:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b302e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829853:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829860:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829865:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829870:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.829873:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829879:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829886:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995d4233c100) 00010000:00010000:0.0:1788581334.829889:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.829891:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829897:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b30304 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.829909:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830421:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830446:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830451:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.830454:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830460:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830470:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581334.830473:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581334.830476:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830481:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b303d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830496:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830501:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830506:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830511:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581334.830514:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.830530:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581334.830539:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1788581334.830540:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:0.0:1788581334.830546:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581334.830550:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581334.830553:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:0.0:1788581334.830558:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30493 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831093:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581334.831101:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831111:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581334.831114:0:10311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831122:0:10311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831136:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831143:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f4b595/0x50f0cc74b7b304bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.831160:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581334.831162:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581334.831164:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581334.833882:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.833994:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170488960 00000100:00100000:3.0:1788581334.834017:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170488960 00000100:00100000:3.0:1788581334.834107:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1788581334.834117:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2395:x1875463170488960:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788581334.835997:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788581334.836019:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788581334.836408:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170488960:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 2287us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.836418:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1788581334.839750:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.839829:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489216 00000100:00100000:3.0:1788581334.839838:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489216 00000100:00100000:3.0:1788581334.839894:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1788581334.839905:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11372:x1875463170489216:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581334.839958:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.839984:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b304a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22176 expref: 16 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.840003:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:3.0:1788581334.840008:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581334.840037:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.840050:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.840060:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581334.840165:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceb623c4 reply state 00000000c123f4ac transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.840189:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.840209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:3.0:1788581334.840212:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581334.840215:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581334.840539:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11372:x1875463170489216:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 634us (796us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788581334.840546:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:2.0:1788581334.843344:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.843468:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489344 00000100:00100000:1.0:1788581334.843478:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489344 00000100:00100000:1.0:1788581334.843529:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1788581334.843538:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170489344:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581334.843696:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788581334.843699:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788581334 -> 1788581334 00002000:00010000:1.0:1788581334.843702:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788581333 00002000:00010000:1.0:1788581334.843704:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788581334 -> 1788581334 00002000:00010000:1.0:1788581334.843706:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788581334.843761:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170489344:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 223us (425us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788581334.843768:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1788581334.846738:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.846829:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489600 00000100:00100000:1.0:1788581334.846839:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489600 00000100:00100000:1.0:1788581334.846894:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:1.0:1788581334.846903:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:11372:x1875463170489600:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788581334.846969:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.846985:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 17 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.846995:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.847030:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 17 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.847062:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 17 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.847075:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184184064:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581334.847154:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581334.849466:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184184064:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581334.849491:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.849987:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184184576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850058:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184185088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850083:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850105:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788581334.850111:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184184192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850156:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184184704:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850205:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850221:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184185216:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850286:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184184320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850326:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184184832:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850358:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184185344:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850378:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850399:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788581334.850404:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184184448:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850425:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850439:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184184960:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850458:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.850469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184185472:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.850488:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581334.850658:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185088 00000100:00100000:2.0:1788581334.850664:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185088 00000100:00100000:2.0:1788581334.850719:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185472 00000100:00100000:2.0:1788581334.850722:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185472 00000100:00100000:2.0:1788581334.850746:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581334.850754:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184185088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.850802:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184185088:12345-0@lo:400:kworker.0 Request processed in 49us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.850810:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581334.850826:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788581334.850832:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184185472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.850879:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184185472:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.850886:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788581334.850903:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184704 00000100:00100000:2.0:1788581334.850906:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184704 00000100:00100000:2.0:1788581334.850926:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184448 00000100:00100000:2.0:1788581334.850934:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184448 00000100:00100000:2.0:1788581334.850950:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788581334.850956:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184184704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.850988:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184184704:12345-0@lo:400:kworker.0 Request processed in 32us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.850994:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788581334.851005:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581334.851011:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184184448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851034:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184184448:12345-0@lo:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581334.851070:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184184448:0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851080:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184185472:0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851108:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184576 00000100:00100000:2.0:1788581334.851112:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184576 00000100:00100000:2.0:1788581334.851128:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185216 00000100:00100000:2.0:1788581334.851131:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185216 00000100:00100000:2.0:1788581334.851141:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184320 00000100:00100000:2.0:1788581334.851143:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184320 00000100:00100000:2.0:1788581334.851153:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184832 00000100:00100000:2.0:1788581334.851155:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184832 00000100:00100000:2.0:1788581334.851164:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185344 00000100:00100000:2.0:1788581334.851197:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185344 00000100:00100000:2.0:1788581334.851213:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184960 00000100:00100000:2.0:1788581334.851216:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184960 00000100:00100000:2.0:1788581334.851228:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788581334.851233:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184184576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851289:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184184576:12345-0@lo:400:kworker.0 Request processed in 55us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851301:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788581334.851314:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788581334.851320:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184185216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851347:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184185216:12345-0@lo:400:kworker.0 Request processed in 28us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851353:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788581334.851362:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788581334.851367:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184184320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851394:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184184320:12345-0@lo:400:kworker.0 Request processed in 27us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851401:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788581334.851424:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184184320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851657:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788581334.851666:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184184832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851700:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184184832:12345-0@lo:400:kworker.0 Request processed in 36us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851706:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788581334.851726:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184184832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851742:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788581334.851747:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851776:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184185344:12345-0@lo:400:kworker.0 Request processed in 29us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851782:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00080000:2.0:1788581334.851816:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a96680 x1875463184185344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581334.851826:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184185344:0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851845:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788581334.851851:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184184960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581334.851884:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184184960:12345-0@lo:400:kworker.0 Request processed in 33us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.851890:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:2.0:1788581334.851911:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43ab1500 x1875463184184960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581334.851920:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184184960:0@lo:400:kworker.0 00000100:00080000:0.0:1788581334.852005:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581334.852010:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581334.852013:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581334.852015:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581334.853313:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184185600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581334.853371:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581334.853425:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184184704:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.853437:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184185216:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.853448:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184184576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581334.853459:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184185088:0@lo:400:kworker.0 00000100:00100000:3.0:1788581334.853956:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184184192 00000100:00100000:3.0:1788581334.853962:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184184192 00000100:00100000:3.0:1788581334.854013:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788581334.854022:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184184192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581334.854070:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e66293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184184192:12345-0@lo:400:kworker.0 Request processed in 50us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.854077:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788581334.854113:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184185728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581334.854140:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581334.854183:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185600 00000100:00100000:3.0:1788581334.854187:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185600 00000100:00100000:3.0:1788581334.854211:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184185728 00000100:00100000:3.0:1788581334.854213:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184185728 00000100:00100000:3.0:1788581334.854226:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581334.854232:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184185600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581334.854247:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788581334.854307:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184185600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.854314:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581334.854326:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788581334.854347:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184185728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581334.854370:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788581334.854399:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184185728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.854405:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788581334.854433:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788581334.854438:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:3.0:1788581334.854454:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d439d9880, transno 4294967310 00000004:00080000:3.0:1788581334.854462:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d439d9c00, transno 4294967311 00000100:00100000:3.0:1788581334.854471:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184185728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581334.855003:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184185600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581334.855015:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184184192:0@lo:400:kworker.0 00000100:00100000:0.0:1788581334.860596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.860820:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489728 00000100:00100000:3.0:1788581334.860831:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489728 00010000:00010000:3.0:1788581334.860870:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 18 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581334.860912:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1788581334.860922:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170489728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581334.860935:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.860942:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 18 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.860956:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 18 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.860978:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3048c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22168 expref: 18 pid: 11562 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.861014:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:3.0:1788581334.861020:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.861029:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.861036:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.861070:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581334.861124:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:2396:x1875463170489728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 203us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.861132:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00010000:00010000:1.0:1788581334.861793:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861803:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861840:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861847:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861863:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861870:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.861874:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861882:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861894:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:1.0:1788581334.861897:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788581334.861901:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.861907:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.861966:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11372:x1875463170489600:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 15062us (15235us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788581334.861975:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1788581334.868039:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.868130:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489856 00000100:00100000:1.0:1788581334.868141:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489856 00000100:00100000:1.0:1788581334.868207:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1788581334.868218:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170489856:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788581334.868288:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.868308:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.868330:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788581334.868335:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581334.868339:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.868385:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.868398:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 7 pid: 8409 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.868414:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1875463184185856:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581334.868484:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581334.872396:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.872541:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170489984 00000100:00100000:2.0:1788581334.872550:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170489984 00010000:00010000:2.0:1788581334.872596:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 8 pid: 8409 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.872647:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:2.0:1788581334.872657:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170489984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581334.872671:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581334.872691:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 8 pid: 8409 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.872706:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 8 pid: 8409 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.872749:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581334.872754:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581334.872760:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.872770:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.872789:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581334.872846:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170489984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 190us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.872854:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00010000:00010000:1.0:1788581334.873547:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b304b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22184 expref: 7 pid: 8409 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.873565:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1875463184185856:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581334.873586:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873614:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873622:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873652:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873662:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873670:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873676:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581334.873681:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873690:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873703:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.873711:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006259682f/0x50f0cc74b7b304d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.873763:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2393:x1875463170489856:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 5546us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.873771:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1788581334.878937:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581334.879038:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170490240 00000100:00100000:2.0:1788581334.879048:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170490240 00000100:00100000:2.0:1788581334.879139:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:2.0:1788581334.879150:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:11372:x1875463170490240:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581334.879228:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.879245:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.879277:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.879307:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.879331:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 16 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.879346:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184185984:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581334.879514:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.882043:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184185984:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581334.882069:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.884332:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.884649:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170490368 00000100:00100000:3.0:1788581334.884658:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170490368 00010000:00010000:3.0:1788581334.884693:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581334.884731:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:3.0:1788581334.884740:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:2394:x1875463170490368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581334.884753:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.884760:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884773:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884811:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b303cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22130 expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884826:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581334.884831:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884840:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884847:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884854:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.884884:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581334.884992:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:2394:x1875463170490368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 252us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.885000:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00010000:00010000:2.0:1788581334.885124:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885133:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885326:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885339:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885347:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885388:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.885401:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 16 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.885423:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184186112:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581334.885477:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.893039:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.893494:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184186112:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581334.893521:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581334.893970:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170490496 00000100:00100000:3.0:1788581334.893978:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170490496 00010000:00010000:0.0:1788581334.894091:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.894191:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:0.0:1788581334.894201:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:2395:x1875463170490496:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581334.894216:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581334.894225:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894237:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894300:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3049a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2216f expref: 17 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894319:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:0.0:1788581334.894324:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894333:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894341:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581334.894480:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581334.894540:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:2395:x1875463170490496:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 339us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581334.894548:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00010000:00010000:2.0:1788581334.894630:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.894639:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581334.894742:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788581334.894852:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788581334.894890:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788581334.894963:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875463184186240:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788581334.895016:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581334.895053:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184186240 00000100:00100000:2.0:1788581334.895058:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184186240 00000100:00100000:2.0:1788581334.895089:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788581334.895096:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1875463184186240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788581334.895181:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1875463184186240:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581334.895188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788581334.895212:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54da56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.895233:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875463184186240:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788581334.895399:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788581334.895437:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875463184186368:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788581334.895466:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581334.895503:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184186368 00000100:00100000:2.0:1788581334.895508:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184186368 00000100:00100000:2.0:1788581334.895531:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788581334.895538:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875463184186368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788581334.895623:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6493:x1875463184186368:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (156us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788581334.895629:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788581334.895647:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.895664:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6493:1875463184186368:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788581334.895692:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895699:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895706:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895712:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581334.895716:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895723:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895736:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:2.0:1788581334.895739:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581334.895743:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895749:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b304e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895778:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895785:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895790:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895795:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581334.895798:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895803:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895811:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.895814:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581334.895819:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895834:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895842:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.895867:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.895889:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184186496:192.168.203.3@tcp:105: 00000100:00100000:2.0:1788581334.895937:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581334.900116:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184186496:192.168.203.3@tcp:105: 00010000:00010000:2.0:1788581334.900146:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900157:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3042a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900201:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900213:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900224:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900233:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900239:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900246:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900270:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581334.900276:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900299:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900311:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.900314:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581334.900318:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900324:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b304ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900334:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900340:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900347:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900352:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581334.900355:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900361:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900381:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581334.900383:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581334.900386:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581334.900403:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b304e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581334.900563:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11372:x1875463170490240:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 21413us (21632us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788581334.900573:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000020:00080000:2.0:1788581334.900579:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788581334.900597:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581334.900603:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581334.901364:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788581334.901373:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581334.905970:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581334.906272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.906824:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170490624 00000100:00100000:1.0:1788581334.906835:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170490624 00000100:00100000:1.0:1788581334.906877:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170490880 00000100:00100000:1.0:1788581334.906880:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170490880 00000100:00100000:1.0:1788581334.906896:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1788581334.906905:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11371:x1875463170490624:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:1.0:1788581334.907033:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:11371:x1875463170490624:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 128us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.907041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1788581334.907060:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1788581334.907066:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:11372:x1875463170490880:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788581334.907696:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788581334.907728:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788581334.907761:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907777:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907786:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907794:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907800:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907817:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907834:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581334.907864:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581334.907869:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907876:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581334.907880:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907887:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907900:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:1.0:1788581334.907903:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581334.907907:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907913:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.907925:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581334.907926:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581334.907928:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581334.907968:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11372:x1875463170490880:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 899us (1711us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788581334.907975:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000020:00080000:1.0:1788581334.907979:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581334.912898:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.913237:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170491136 00000100:00100000:3.0:1788581334.913246:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170491136 00000100:00100000:3.0:1788581334.917716:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:3.0:1788581334.917731:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11371:x1875463170491136:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:3.0:1788581334.917900:0:11562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788581334.917988:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11371:x1875463170491136:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 259us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.918008:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1788581334.959592:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.959750:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170491264 00000100:00100000:1.0:1788581334.959760:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170491264 00000100:00100000:1.0:1788581334.959816:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:1.0:1788581334.959825:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:11374:x1875463170491264:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581334.959848:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581334.959868:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2218b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959927:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959941:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959953:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959967:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959974:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.959981:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.960044:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.960055:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 22 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.960081:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.960113:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 22 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.960127:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 22 pid: 11562 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581334.960141:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184186624:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581334.960295:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581334.964494:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184186624:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581334.964523:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581334.965054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581334.965297:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170491520 00000100:00100000:1.0:1788581334.965306:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170491520 00000100:00100000:1.0:1788581334.965360:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1788581334.965488:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:6161:x1875463170491520:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788581334.965759:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:6161:x1875463170491520:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 274us (707us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788581334.965767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1788581334.969556:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581334.969750:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170491648 00000100:00100000:3.0:1788581334.969760:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170491648 00010000:00010000:3.0:1788581334.969798:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 24 pid: 11562 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581334.969832:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1788581334.969842:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:2395:x1875463170491648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581334.969854:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581334.969861:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 24 pid: 11562 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969876:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 24 pid: 11562 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969899:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3041c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2214c expref: 24 pid: 11562 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969916:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581334.969920:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969928:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969935:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581334.969984:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581334.970044:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2395:x1875463170491648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 203us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581334.970053:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00010000:00010000:1.0:1788581334.970307:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970316:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581334.970502:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788581334.970507:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581334.970527:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970541:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970552:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970559:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970566:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970572:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.970576:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970714:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970727:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581334.970729:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581334.970733:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970740:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970767:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970773:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970779:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970784:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581334.970787:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970794:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970803:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff995e47fbcf00) 00010000:00010000:1.0:1788581334.970805:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581334.970808:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970813:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3050a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970851:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b304fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2218b expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970865:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2218b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581334.970882:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581334.970884:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581334.970887:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a200, rc 0) 00000100:00100000:1.0:1788581334.970921:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11374:x1875463170491264:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 11097us (11338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581334.970929:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000040:00080000:0.0:1788581335.741685:0:14228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581335.741695:0:14228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581335.741735:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788581335.741742:0:14228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788581335.747464:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581335.874946:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581335.874972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184186752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581335.875039:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581335.875292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184186752 00000100:00100000:0.0:1788581335.875300:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184186752 00000100:00100000:0.0:1788581335.875352:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788581335.875361:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184186752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581335.875406:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581335.875469:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184186752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581335.875476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788581335.875751:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184186752:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788581335.942110:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581335.942120:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581335.942147:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788581335.942153:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581335.942416:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184186880:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581335.946983:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581335.954472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581335.954503:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170491776 00000100:00100000:0.0:1788581335.954511:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170491776 00000100:00100000:0.0:1788581335.954562:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:0.0:1788581335.954572:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:11386:x1875463170491776:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788581335.954607:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788581335.954721:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:11386:x1875463170491776:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 150us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581335.954729:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:2.0:1788581335.956610:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184186880:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581335.973118:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581335.973177:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170492032 00000100:00100000:1.0:1788581335.973266:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170492032 00000100:00100000:1.0:1788581335.973325:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:1.0:1788581335.973336:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:11386:x1875463170492032:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581335.973355:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581335.973373:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30518 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22192 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.973473:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3051f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.973495:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3051f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.973509:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3051f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581335.973521:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788581335.973619:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30518 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22192 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.973637:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3051f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22192 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.973646:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581335.973649:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581335.973653:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581335.973706:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:11386:x1875463170492032:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 372us (597us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788581335.973713:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:0.0:1788581335.989527:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581335.989571:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581335.989602:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170492416 00000100:00100000:1.0:1788581335.989612:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170492416 00000100:00100000:2.0:1788581335.989633:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170492288 00000100:00100000:2.0:1788581335.989638:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170492288 00000100:00100000:2.0:1788581335.989666:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:1.0:1788581335.989668:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1788581335.989675:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:11386:x1875463170492288:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581335.989675:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:2396:x1875463170492416:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581335.989690:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581335.989715:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3051f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22192 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581335.989742:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581335.989750:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:1.0:1788581335.989754:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581335.989811:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:2396:x1875463170492416:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581335.989819:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00010000:00010000:2.0:1788581335.992055:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581335.992080:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993249:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993293:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993301:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993307:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581335.993311:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993319:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993335:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581335.993338:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581335.993344:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581335.993349:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b3052d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581335.993493:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:11386:x1875463170492288:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 3814us (3916us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788581335.993504:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000040:00080000:2.0:1788581335.994867:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581335.994875:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581335.995691:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788581335.995704:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581335.997713:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581335.997800:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170492672 00000100:00100000:3.0:1788581335.997810:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170492672 00000100:00100000:3.0:1788581335.997865:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1788581335.997876:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:11386:x1875463170492672:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581335.998111:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:11386:x1875463170492672:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 235us (406us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788581335.998666:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00010000:00010000:1.0:1788581336.771111:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581337.608005:0:14279:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581337.608015:0:14279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581337.608043:0:14279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788581337.608049:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581337.748093:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581337.748182:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170492928 00000100:00100000:0.0:1788581337.748192:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170492928 00000100:00080000:1.0:1788581337.748350:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581337.748418:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:3.0:1788581337.748431:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:11407:x1875463170492928:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581337.748455:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581337.748474:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b30534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22199 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581337.748702:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3053b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581337.748716:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3053b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581337.748729:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3053b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581337.748758:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788581337.748860:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b30534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22199 expref: 28 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581337.748879:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3053b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22199 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581337.748888:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581337.748890:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788581337.748893:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981400, rc 0) 00000100:00100000:3.0:1788581337.748955:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:11407:x1875463170492928:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 526us (870us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788581337.748963:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:3.0:1788581337.753917:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581337.753989:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493056 00000100:00100000:0.0:1788581337.753997:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493056 00000100:00100000:0.0:1788581337.754052:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:0.0:1788581337.754063:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:11407:x1875463170493056:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581337.754140:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754169:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754182:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754216:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754223:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754230:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754235:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581337.754239:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754246:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754293:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:0.0:1788581337.754296:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581337.754301:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.754308:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b30549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581337.754388:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:11407:x1875463170493056:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 326us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581337.754396:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00010000:00010000:3.0:1788581337.794192:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581337.841775:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581337.842721:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493184 00000100:00100000:0.0:1788581337.842733:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493184 00000100:00100000:0.0:1788581337.842810:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1788581337.842822:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170493184:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1788581337.842839:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581337.842860:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b30550 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221a0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581337.842886:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b95d6, atime: 0x6a9b95d5, ctime: 0x6a9b95d6, blocks: 0x8 00010000:00010000:0.0:1788581337.842904:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1788581337.842908:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581337.842916:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b30550 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a0 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.842936:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b30550 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a0 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581337.842948:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71a00, rc 0) 00000100:00100000:0.0:1788581337.843008:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170493184:12345-192.168.203.3@tcp:101:cat.0 Request processed in 187us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581337.843023:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00080000:1.0:1788581337.843239:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581337.849848:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581337.850101:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493312 00000100:00100000:2.0:1788581337.850110:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493312 00002000:00100000:2.0:1788581337.850181:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff995d43a95f80 x1875463170493312/t0(0) o3->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:693/0 lens 488/0 e 0 to 0 dl 1788581348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581337.850196:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43a95f80 with x1875463170493312 ext(0->4095) 00002000:00010000:2.0:1788581337.850202:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43a95f80 00000100:00100000:2.0:1788581337.850229:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1788581337.850237:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170493312:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:2.0:1788581337.851579:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170493312:12345-192.168.203.3@tcp:3:cat.0 Request processed in 1337us (1734us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788581337.851589:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:2.0:1788581337.851598:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff995d43a95f80 x1875463170493312/t0(0) o3->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:693/0 lens 488/4536 e 0 to 0 dl 1788581348 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581337.851608:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43a95f80 with x1875463170493312 ext(0->4095) 00002000:00010000:2.0:1788581337.851612:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43a95f80 00000100:00100000:1.0:1788581337.922829:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184187008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581337.922902:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581337.923064:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187008 00000100:00100000:3.0:1788581337.923072:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187008 00000100:00100000:3.0:1788581337.923141:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788581337.923160:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184187008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581337.923190:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581337.923238:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184187008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581337.923246:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788581337.923312:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184187008:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581337.923422:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581337.926354:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581337.926387:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184187136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581337.926451:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581337.931234:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187136 00000100:00100000:2.0:1788581337.931250:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187136 00000100:00080000:1.0:1788581337.931434:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581337.931474:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788581337.931485:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184187136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581337.931512:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581337.931657:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d431dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184187136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (5204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581337.931681:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788581337.931965:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788581337.931971:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788581337.931990:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e4303b480, transno 4294967302 00000004:00080000:0.0:1788581337.932008:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788581337.932019:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d43a91880, transno 4294967305 00000100:00100000:0.0:1788581337.932032:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184187136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581338.433876:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184187264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581338.433951:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581338.434538:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187264 00000100:00100000:2.0:1788581338.434548:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187264 00000100:00100000:2.0:1788581338.434608:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788581338.434618:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184187264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581338.434670:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788581338.434736:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184187264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581338.434743:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788581338.434774:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184187264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581338.820365:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581339.073503:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581339.073511:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581339.073533:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788581339.073539:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788581339.587248:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581339.845451:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581339.896333:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581339.896373:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581339.896399:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581339.896435:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493696 00000100:00100000:0.0:1788581339.896438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581339.896446:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493696 00000100:00100000:0.0:1788581339.896462:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581339.896550:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493952 00000100:00100000:2.0:1788581339.896555:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493952 00000100:00100000:3.0:1788581339.898124:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493440 00000100:00100000:3.0:1788581339.898136:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493440 00000100:00100000:3.0:1788581339.898212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 378 00000100:00100000:3.0:1788581339.898222:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170493440:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581339.902482:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:1.0:1788581339.902671:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170493696:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581339.902693:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:2.0:1788581339.902706:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170493952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581339.902855:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e54fa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170493440:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 4631us (6530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.902869:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 378 00000100:00100000:3.0:1788581339.902927:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494208 00000100:00100000:3.0:1788581339.902935:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494208 00000100:00100000:3.0:1788581339.902972:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493568 00000100:00100000:3.0:1788581339.902976:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493568 00000100:00100000:3.0:1788581339.903001:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:0.0:1788581339.903005:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581339.903014:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170494208:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581339.903050:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581339.903057:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170494208:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (6619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.903065:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:3.0:1788581339.903081:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494080 00000100:00100000:3.0:1788581339.903085:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494080 00000100:00100000:0.0:1788581339.903111:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:0.0:1788581339.903122:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:2395:x1875463170493568:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581339.903172:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:2395:x1875463170493568:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 53us (6710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.903643:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00100000:0.0:1788581339.903658:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:3.0:1788581339.903660:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170494080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581339.903686:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170493824 00000100:00100000:0.0:1788581339.903690:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170493824 00000100:00100000:3.0:1788581339.903696:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170494080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.903704:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00100000:0.0:1788581339.903725:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:0.0:1788581339.903734:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170493824:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581339.903767:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170493824:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581339.903773:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00080000:3.0:1788581339.903843:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581339.903848:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581339.903850:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581339.903854:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581339.904741:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170493952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2034us (8335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.904753:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:1.0:1788581339.905091:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170493696:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2433us (8714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581339.905101:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:0.0:1788581339.970553:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184187520:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.970620:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.970676:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184188032:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.970698:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.970720:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184188544:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.970739:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.970763:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788581339.970769:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184187392:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.971439:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.971465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184187904:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.971491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.971507:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184188416:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.971528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.971547:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184188928:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.971569:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581339.971596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187520 00000100:00100000:3.0:1788581339.971605:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187520 00000100:00100000:0.0:1788581339.971615:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184187776:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.971657:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581339.971714:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184187648:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.971842:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581339.971852:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184189056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581339.972128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581339.972166:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184188160:0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.972201:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.975532:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184188288:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.975599:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.975671:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184188800:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.975706:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581339.975760:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187392 00000100:00100000:0.0:1788581339.975768:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187392 00000100:00100000:0.0:1788581339.975833:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788581339.975843:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184187392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.975891:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184187392:12345-0@lo:400:kworker.0 Request processed in 50us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581339.975898:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788581339.976207:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188032 00000100:00100000:3.0:1788581339.976213:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188032 00000100:00100000:3.0:1788581339.976232:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188544 00000100:00100000:3.0:1788581339.976235:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188544 00000100:00100000:3.0:1788581339.976279:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187776 00000100:00100000:3.0:1788581339.976283:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187776 00000100:00100000:3.0:1788581339.976297:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788581339.976305:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184187520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.976426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184187520:12345-0@lo:400:kworker.0 Request processed in 121us (5805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.976434:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788581339.976450:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581339.976482:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189056 00000100:00100000:2.0:1788581339.976486:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189056 00000100:00100000:2.0:1788581339.976518:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788581339.976525:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184189056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581339.976547:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788581339.976582:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184189056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.976588:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788581339.976600:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184188544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.976610:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788581339.976703:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184188672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.976731:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581339.976758:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187904 00000100:00100000:1.0:1788581339.976762:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187904 00000100:00100000:1.0:1788581339.976805:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184187648 00000100:00100000:1.0:1788581339.976809:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184187648 00000100:00100000:1.0:1788581339.976822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581339.976828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184187904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.976863:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184187904:12345-0@lo:400:kworker.0 Request processed in 36us (5371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581339.976869:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581339.976881:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581339.976886:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184187648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.976927:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184187648:12345-0@lo:400:kworker.0 Request processed in 30us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581339.976933:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581339.976969:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184187648:0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.976988:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188160 00000100:00100000:1.0:1788581339.976992:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188160 00000100:00100000:1.0:1788581339.977009:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188672 00000100:00100000:1.0:1788581339.977011:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188672 00000100:00100000:1.0:1788581339.977024:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788581339.977029:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184187776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.977076:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184187776:12345-0@lo:400:kworker.0 Request processed in 46us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581339.977082:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788581339.977106:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184187776:0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.977123:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788581339.977129:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184188160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.977172:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184188544:12345-0@lo:400:kworker.0 Request processed in 574us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.977179:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788581339.977192:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184187392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.977197:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788581339.977208:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977213:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184187904:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977229:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184187520:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977244:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184188544:0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.977278:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184188672:12345-0@lo:400:kworker.0 Request processed in 71us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.977286:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788581339.977305:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188416 00000100:00100000:2.0:1788581339.977309:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188416 00000100:00100000:2.0:1788581339.977331:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188928 00000100:00100000:2.0:1788581339.977335:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188928 00000100:00100000:2.0:1788581339.977351:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188288 00000100:00100000:2.0:1788581339.977354:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188288 00000100:00100000:3.0:1788581339.977362:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184188800 00000100:00100000:3.0:1788581339.977367:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184188800 00000100:00100000:2.0:1788581339.977373:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788581339.977383:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184188416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.977393:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788581339.977402:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184188928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977431:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184188416:12345-0@lo:400:kworker.0 Request processed in 49us (5900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.977439:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788581339.977446:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184188928:12345-0@lo:400:kworker.0 Request processed in 45us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.977454:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581339.977461:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977491:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184188288:12345-0@lo:400:kworker.0 Request processed in 30us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.977496:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581339.977507:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788581339.977513:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184188800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977537:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184188800:12345-0@lo:400:kworker.0 Request processed in 25us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.977551:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788581339.977579:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184188416:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977589:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184188928:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.977618:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184189056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581339.977638:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788581339.977659:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581339.977664:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581339.977666:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581339.977669:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581339.977684:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788581339.977693:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184188032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581339.977733:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184188032:12345-0@lo:400:kworker.0 Request processed in 42us (7033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581339.977740:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788581339.977744:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184188032:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.978612:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184189184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581339.978651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788581339.978686:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43b41880 x1875463184188672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581339.978697:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184188672:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.978734:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184188288:0@lo:400:kworker.0 00000100:00100000:0.0:1788581339.978744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184188800:0@lo:400:kworker.0 00000100:00100000:1.0:1788581339.978964:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184188160:12345-0@lo:400:kworker.0 Request processed in 1833us (6760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581339.978972:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1788581339.979046:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43b42300 x1875463184188160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581339.979055:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184188160:0@lo:400:kworker.0 00000100:00100000:2.0:1788581339.979129:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189184 00000100:00100000:2.0:1788581339.979136:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189184 00000100:00100000:2.0:1788581339.979532:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788581339.979541:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184189184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581339.979560:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788581339.979604:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184189184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581339.979610:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788581339.979996:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184189184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581340.865869:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581340.995153:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581340.995174:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184189312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581340.995238:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581340.995401:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189312 00000100:00100000:0.0:1788581340.995408:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189312 00000100:00100000:0.0:1788581340.995460:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788581340.995470:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184189312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581340.995500:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581340.995578:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184189312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581340.995585:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788581340.995727:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184189312:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788581341.013430:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788581341.013451:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1788581341.023818:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788581341.023859:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e81fec240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788581341.023865:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e4eb95b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e47a7a9c0 00000020:00080000:2.0:1788581341.023868:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e6fb0aa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995d422f0000 00000020:00080000:2.0:1788581341.023896:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788581341.023934:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788581341.024037:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788581341.027432:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027451:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027460:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027468:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581341.027474:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027485:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027507:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff995e6f928300) 00010000:00010000:3.0:1788581341.027530:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581341.027537:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581341.027546:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b304cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581341.890205:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581342.913518:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581343.041487:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581343.041510:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184189440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581343.041596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581343.043460:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581343.043478:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184189568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581343.043530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581343.048750:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189440 00000100:00100000:3.0:1788581343.048764:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189440 00000100:00100000:3.0:1788581343.048991:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189568 00000100:00100000:3.0:1788581343.048996:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189568 00000100:00100000:2.0:1788581343.049060:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788581343.049071:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184189440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581343.049103:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581343.049178:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184189440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581343.049185:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788581343.049234:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184189440:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581343.050141:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581343.051601:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788581343.051615:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184189568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581343.051640:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581343.051732:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184189568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (8200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581343.051740:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788581343.052172:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184189568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581343.259935:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581343.267994:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494336 00000100:00100000:2.0:1788581343.268009:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494336 00000100:00100000:0.0:1788581343.268195:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:0.0:1788581343.268208:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11060:x1875463170494336:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788581343.268345:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11060:x1875463170494336:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 140us (8418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581343.268353:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00080000:1.0:1788581343.270802:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581343.275130:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581343.275217:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494464 00000100:00100000:2.0:1788581343.275227:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494464 00000100:00100000:2.0:1788581343.275327:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:2.0:1788581343.275338:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:11060:x1875463170494464:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788581343.275436:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:11060:x1875463170494464:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581343.275443:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00080000:1.0:1788581343.275914:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581343.286040:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581343.286149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494720 00000100:00100000:1.0:1788581343.286158:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494720 00000100:00100000:1.0:1788581343.286218:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581343.286228:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:11060:x1875463170494720:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788581343.286464:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:11060:x1875463170494720:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 237us (434us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788581343.286472:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581343.553640:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184189696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581343.553729:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581343.553860:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189696 00000100:00100000:3.0:1788581343.553868:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189696 00000100:00100000:3.0:1788581343.553920:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788581343.553929:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184189696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581343.553959:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788581343.554006:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184189696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581343.554012:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788581343.554096:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184189696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581343.579094:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581343.579244:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494848 00000100:00100000:1.0:1788581343.579289:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494848 00000100:00100000:1.0:1788581343.579387:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1788581343.579401:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:11866:x1875463170494848:12345-192.168.203.3@tcp:101:lsof.0 00010000:00010000:1.0:1788581343.579430:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788581343.580338:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581343.583134:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221a7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.583220:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.583234:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.583246:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581343.583959:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581343.583966:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581343.584014:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.584194:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.584217:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581343.584226:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:1.0:1788581343.584243:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581343.584247:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581343.584733:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:11866:x1875463170494848:12345-192.168.203.3@tcp:101:lsof.0 Request processed in 5333us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581343.584743:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00010000:00010000:3.0:1788581343.937549:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581344.964775:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581345.000335:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581345.000383:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581345.000424:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581345.000458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581345.000504:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581345.000703:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495488 00000100:00100000:1.0:1788581345.000715:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495488 00000100:00100000:1.0:1788581345.000793:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:1.0:1788581345.000805:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170495488:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581345.000899:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170495488:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581345.000907:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00080000:1.0:1788581345.000932:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581345.000964:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495232 00000100:00100000:1.0:1788581345.000968:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495232 00000100:00100000:1.0:1788581345.001002:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495744 00000100:00100000:1.0:1788581345.001005:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495744 00000100:00100000:1.0:1788581345.001021:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495104 00000100:00100000:1.0:1788581345.001024:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495104 00000100:00100000:1.0:1788581345.001040:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1788581345.001047:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170495232:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581345.001080:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170495232:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581345.001087:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1788581345.001098:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 280 00000100:00100000:1.0:1788581345.001104:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170495744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581345.001146:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170495744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581345.001160:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 280 00000100:00100000:1.0:1788581345.001173:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:1.0:1788581345.001180:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:2395:x1875463170495104:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581345.001213:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:2395:x1875463170495104:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581345.001219:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00080000:1.0:1788581345.001234:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581345.001237:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581345.001345:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170494976 00000100:00100000:3.0:1788581345.001351:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170494976 00000100:00100000:3.0:1788581345.001393:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 380 00000100:00100000:3.0:1788581345.001400:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170494976:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581345.001429:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170494976:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581345.001434:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 380 00000100:00100000:2.0:1788581345.001654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581345.001752:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581345.002917:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495616 00000100:00100000:0.0:1788581345.002932:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495616 00000100:00100000:0.0:1788581345.003024:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 282 00000100:00100000:0.0:1788581345.003035:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2395:x1875463170495616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581345.003126:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2395:x1875463170495616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 92us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.003133:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 282 00000100:00080000:2.0:1788581345.003358:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581345.003951:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170495360 00000100:00100000:3.0:1788581345.003960:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170495360 00000100:00100000:3.0:1788581345.004117:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:3.0:1788581345.004130:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170495360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581345.004198:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170495360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 72us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581345.004206:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00080000:2.0:1788581345.006129:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581345.090150:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184189824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581345.090281:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581345.090814:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581345.090827:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184190208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.090875:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581345.090921:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190208 00000100:00100000:3.0:1788581345.090931:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190208 00000100:00100000:3.0:1788581345.091001:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788581345.091012:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184190208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.091082:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184190208:12345-0@lo:400:kworker.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581345.091090:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788581345.091153:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184190208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.091215:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184190336:0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.091308:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581345.091346:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190336 00000100:00100000:3.0:1788581345.091351:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190336 00000100:00100000:3.0:1788581345.091383:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788581345.091391:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184190336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.091428:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184190336:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581345.091435:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788581345.091464:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184190336:0@lo:400:kworker.0 00000100:00100000:3.0:1788581345.091508:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581345.091514:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184190720:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.091711:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189824 00000100:00100000:2.0:1788581345.091717:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189824 00000100:00100000:2.0:1788581345.091918:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581345.091928:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184189824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581345.091959:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788581345.092042:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184189952:0@lo:400:kworker.0 00000100:00080000:1.0:1788581345.092191:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581345.092211:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184190080:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.093173:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184189824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1239us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.093186:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581345.093421:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184191232:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.093466:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581345.093518:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581345.093653:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184190848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.093836:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581345.093862:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184191360:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.093886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581345.093921:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190848 00000100:00100000:2.0:1788581345.093932:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190848 00000100:00100000:2.0:1788581345.094000:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191360 00000100:00100000:2.0:1788581345.094003:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191360 00000100:00100000:2.0:1788581345.094032:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581345.094041:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184190848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.094101:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184190848:12345-0@lo:400:kworker.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.094140:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581345.094156:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581345.094162:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184191360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.094194:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184191360:12345-0@lo:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.094200:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788581345.094226:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581345.094231:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581345.094298:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184190848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.094310:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788581345.094316:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788581345.094347:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184191360:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.094398:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191232 00000100:00100000:2.0:1788581345.094402:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191232 00000100:00100000:2.0:1788581345.094440:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788581345.094447:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184191232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.094490:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184191232:12345-0@lo:400:kworker.0 Request processed in 42us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.094496:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1788581345.094511:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581345.094873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581345.094914:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184190464:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.094948:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581345.094986:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184190976:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095013:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581345.095032:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581345.095061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581345.095086:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581345.095094:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581345.095168:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184189952 00000100:00100000:0.0:1788581345.095173:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184189952 00000100:00100000:0.0:1788581345.095214:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788581345.095222:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184189952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095282:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e51d19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184189952:12345-0@lo:400:kworker.0 Request processed in 61us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.095290:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788581345.095326:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191104 00000100:00100000:0.0:1788581345.095329:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191104 00000100:00100000:0.0:1788581345.095363:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788581345.095370:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184191104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095404:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184191104:12345-0@lo:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.095425:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1788581345.095445:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581345.095470:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095481:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184189952:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095807:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190464 00000100:00100000:0.0:1788581345.095813:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190464 00000100:00100000:0.0:1788581345.095848:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788581345.095856:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184190464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095906:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184190464:12345-0@lo:400:kworker.0 Request processed in 51us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.095913:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788581345.095946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184190464:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.095982:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190976 00000100:00100000:0.0:1788581345.095985:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190976 00000100:00100000:0.0:1788581345.096019:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581345.096026:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184190976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.096066:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184190976:12345-0@lo:400:kworker.0 Request processed in 41us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.096073:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788581345.096087:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581345.096104:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184190976:0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.096161:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191488 00000100:00100000:0.0:1788581345.096166:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191488 00000100:00100000:0.0:1788581345.096194:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788581345.096201:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184191488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581345.096232:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00010000:00080000:2.0:1788581345.096664:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4384f100 x1875463184191232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581345.096692:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184191232:0@lo:400:kworker.0 00000100:00100000:1.0:1788581345.100999:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581345.101083:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184190592:0@lo:400:kworker.0 00000100:00100000:1.0:1788581345.101148:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581345.101499:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190080 00000100:00100000:2.0:1788581345.101512:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190080 00000100:00100000:2.0:1788581345.101630:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190592 00000100:00100000:2.0:1788581345.101634:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190592 00000100:00100000:2.0:1788581345.101697:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788581345.101710:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184190080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.102049:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184190080:12345-0@lo:400:kworker.0 Request processed in 341us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.102059:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788581345.102085:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788581345.102094:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184190592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.102136:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184190592:12345-0@lo:400:kworker.0 Request processed in 44us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581345.102143:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1788581345.102171:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581345.103196:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184191488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6984us (8122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.103212:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788581345.103419:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184190080:0@lo:400:kworker.0 00000100:00100000:1.0:1788581345.103440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184190592:0@lo:400:kworker.0 00000100:00100000:2.0:1788581345.103960:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581345.105229:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581345.105351:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184189824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581345.105488:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184190720 00000100:00100000:0.0:1788581345.105497:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184190720 00000100:00100000:0.0:1788581345.105627:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788581345.105640:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184190720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581345.105973:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184190720:12345-0@lo:400:kworker.0 Request processed in 334us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581345.105982:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:3.0:1788581345.106104:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a91180 x1875463184190720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581345.106130:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184190720:0@lo:400:kworker.0 00000100:00080000:2.0:1788581345.106911:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788581345.987631:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581346.114146:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184191616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581346.114221:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581346.114374:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191616 00000100:00100000:3.0:1788581346.114383:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191616 00000100:00100000:3.0:1788581346.114431:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788581346.114441:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184191616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581346.114477:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788581346.114533:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184191616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581346.114539:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788581346.114626:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184191616:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788581346.635863:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788581346.635878:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788581346.635940:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788581346.635978:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788581347.011320:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581347.946848:0:14477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:09:05 (1788581345) 00010000:00010000:1.0:1788581348.034144:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581348.161746:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184191872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581348.161842:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184191744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581348.161925:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581348.162012:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191744 00000100:00100000:2.0:1788581348.162020:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191744 00000100:00100000:2.0:1788581348.162102:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788581348.162113:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184191744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581348.162217:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581348.162312:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184191744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581348.162331:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788581348.162357:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581348.162398:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184191744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581348.162570:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581348.163296:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184191872 00000100:00100000:2.0:1788581348.163305:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184191872 00000100:00100000:2.0:1788581348.163362:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788581348.163373:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184191872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581348.163395:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581348.163448:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184191872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581348.163455:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788581348.164314:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184191872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788581348.164359:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581348.673595:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184192000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581348.673706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581348.673943:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192000 00000100:00100000:3.0:1788581348.673952:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192000 00000100:00100000:3.0:1788581348.674020:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788581348.674032:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184192000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581348.674094:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788581348.674162:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184192000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581348.674171:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788581348.674328:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184192000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788581349.060234:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581349.314771:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581349.314784:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581349.314917:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788581349.314926:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581349.746475:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581349.746610:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496000 00000100:00100000:2.0:1788581349.746628:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496000 00000100:00100000:2.0:1788581349.746756:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:2.0:1788581349.746770:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:12133:x1875463170496000:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581349.746791:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581349.746813:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30565 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221ae expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.746886:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.746901:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.746929:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747002:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747011:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747017:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747150:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3057a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747160:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3057a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747166:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3057a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581349.747175:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788581349.747310:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747318:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747324:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747330:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581349.747340:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747347:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747360:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4233c000) 00010000:00010000:2.0:1788581349.747363:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581349.747368:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747373:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3056c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747386:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747392:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747397:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747402:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581349.747405:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747410:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747416:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff995d42038000) 00010000:00010000:2.0:1788581349.747418:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581349.747426:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747432:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30573 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747711:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30565 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ae expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747727:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3057a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ae expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581349.747735:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:2.0:1788581349.747738:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581349.747740:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:2.0:1788581349.749235:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:12133:x1875463170496000:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2458us (2766us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788581349.749249:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00080000:3.0:1788581349.749696:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581349.762489:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581349.764290:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581349.769755:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496256 00000100:00100000:1.0:1788581349.769780:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496256 00000100:00100000:1.0:1788581349.769921:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1788581349.769938:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:12133:x1875463170496256:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788581349.770124:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:12133:x1875463170496256:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 191us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581349.770133:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:0.0:1788581349.774185:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496128 00000100:00100000:0.0:1788581349.774210:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496128 00000100:00100000:0.0:1788581349.774368:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581349.774383:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45353c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:2395:x1875463170496128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581349.774405:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581349.774441:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b3057a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ae expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581349.774469:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:0.0:1788581349.774475:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581349.774888:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45353c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:2395:x1875463170496128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 506us (12416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581349.774919:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581349.779991:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581349.780312:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496384 00000100:00100000:1.0:1788581349.780329:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496384 00000100:00100000:1.0:1788581349.780428:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1788581349.780443:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:12133:x1875463170496384:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788581349.780877:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581349.781195:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:12133:x1875463170496384:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 751us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581349.781206:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000040:00080000:3.0:1788581349.830367:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581350.091460:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581350.124035:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581350.124092:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581350.124138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581350.124160:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581350.124186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581350.124213:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496896 00000100:00100000:1.0:1788581350.124224:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496896 00000100:00100000:1.0:1788581350.124314:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497024 00000100:00100000:1.0:1788581350.124317:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497024 00000100:00100000:1.0:1788581350.124357:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:1.0:1788581350.124368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2395:x1875463170496896:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581350.124669:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2395:x1875463170496896:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 301us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.124679:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:1.0:1788581350.124699:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:1.0:1788581350.124707:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170497024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581350.124737:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170497024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.124761:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:1.0:1788581350.124783:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496512 00000100:00100000:1.0:1788581350.124787:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496512 00000100:00100000:1.0:1788581350.124939:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 382 00000100:00100000:1.0:1788581350.124949:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170496512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581350.124978:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170496512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.124985:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 382 00000100:00100000:1.0:1788581350.125017:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496640 00000100:00100000:1.0:1788581350.125021:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496640 00000100:00100000:1.0:1788581350.125051:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170496768 00000100:00100000:1.0:1788581350.125055:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170496768 00000100:00100000:1.0:1788581350.125089:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:1.0:1788581350.125097:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170496640:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581350.125190:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2395:x1875463170496640:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 94us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.125197:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:1.0:1788581350.125210:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:1.0:1788581350.125216:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170496768:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581350.125239:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170496768:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.125244:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00080000:1.0:1788581350.125295:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581350.125300:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581350.125302:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581350.125314:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581350.209686:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184192128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581350.209756:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581350.209930:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192128 00000100:00100000:0.0:1788581350.209940:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192128 00000100:00100000:0.0:1788581350.210011:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788581350.210022:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184192128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581350.210053:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788581350.210241:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581350.210290:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581350.210751:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581350.212752:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192256 00000100:00100000:2.0:1788581350.212766:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192256 00000100:00100000:2.0:1788581350.213634:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788581350.213700:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184192256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581350.213725:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788581350.213801:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184192256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581350.213808:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788581350.213969:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184192256:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788581350.213991:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581350.221446:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184192384:0@lo:400:kworker.0 00000100:00100000:3.0:1788581350.221525:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581350.221614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184192512:0@lo:400:kworker.0 00000100:00100000:3.0:1788581350.221648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581350.221703:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192512 00000100:00100000:3.0:1788581350.221712:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192512 00000100:00100000:3.0:1788581350.221765:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788581350.221774:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.222121:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184192128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12099us (12362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.222131:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788581350.222167:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192384 00000100:00100000:0.0:1788581350.222171:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192384 00000100:00100000:0.0:1788581350.222205:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788581350.222212:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184192384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.222282:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e717c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184192384:12345-0@lo:400:kworker.0 Request processed in 70us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.222288:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788581350.222530:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184192384:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.222788:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581350.222797:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184192768:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.222843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581350.222887:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.222913:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581350.222940:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192896 00000100:00100000:0.0:1788581350.222945:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192896 00000100:00100000:0.0:1788581350.222986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788581350.222992:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.223032:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184192896:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.223039:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788581350.223066:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226232:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581350.226251:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184193280:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226332:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581350.226461:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184193408:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581350.226571:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192768 00000100:00100000:0.0:1788581350.226578:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192768 00000100:00100000:0.0:1788581350.226617:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788581350.226625:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226673:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184192768:12345-0@lo:400:kworker.0 Request processed in 48us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.226680:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788581350.226718:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184192768:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226749:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193280 00000100:00100000:0.0:1788581350.226753:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193280 00000100:00100000:0.0:1788581350.226787:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193408 00000100:00100000:0.0:1788581350.226790:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193408 00000100:00100000:0.0:1788581350.226827:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788581350.226834:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184193280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226871:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184193280:12345-0@lo:400:kworker.0 Request processed in 38us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.226884:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788581350.226898:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788581350.226905:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184193408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.226938:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184193408:12345-0@lo:400:kworker.0 Request processed in 34us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.226946:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788581350.226967:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184192128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788581350.226967:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581350.226993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184193408:0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.227005:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184193280:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227010:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184192640:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227043:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581350.227071:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184192640 00000100:00100000:1.0:1788581350.227085:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184192640 00000100:00100000:1.0:1788581350.227113:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788581350.227120:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184192640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227154:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184192640:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.227161:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788581350.227188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184192640:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227195:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184193152:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227219:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581350.227238:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193152 00000100:00100000:1.0:1788581350.227241:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193152 00000100:00100000:1.0:1788581350.227309:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788581350.227315:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184193152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227348:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184193152:12345-0@lo:400:kworker.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.227354:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1788581350.227384:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788581350.227403:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43b4c700 x1875463184193152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581350.227428:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184193152:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227435:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184193664:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227459:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581350.227495:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788581350.227501:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184193024:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227522:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581350.227541:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193664 00000100:00100000:1.0:1788581350.227545:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193664 00000100:00100000:1.0:1788581350.227567:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193024 00000100:00100000:1.0:1788581350.227570:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193024 00000100:00100000:1.0:1788581350.227588:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788581350.227594:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184193664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581350.227605:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788581350.227617:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184193024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227630:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184193664:12345-0@lo:400:kworker.0 Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581350.227636:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1788581350.227655:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581350.227659:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581350.227663:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184193024:12345-0@lo:400:kworker.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581350.227673:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788581350.227682:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184193024:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227691:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184193536:0@lo:400:kworker.0 00000100:00100000:1.0:1788581350.227714:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788581350.227747:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d439dad80 x1875463184193664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581350.227759:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184193664:0@lo:400:kworker.0 00000100:00100000:3.0:1788581350.227770:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184192512:12345-0@lo:400:kworker.0 Request processed in 5993us (6118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581350.227779:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788581350.227798:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193536 00000100:00100000:3.0:1788581350.227802:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193536 00000100:00100000:1.0:1788581350.227811:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184192512:0@lo:400:kworker.0 00000100:00080000:3.0:1788581350.227824:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581350.227857:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788581350.227864:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581350.227904:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184193536:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581350.227910:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788581350.228085:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184193536:0@lo:400:kworker.0 00000040:00080000:2.0:1788581350.339860:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581350.339873:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581350.340470:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788581350.340481:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788581351.105690:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581351.245320:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581351.245345:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184193792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581351.245505:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581351.245574:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184193792 00000100:00100000:0.0:1788581351.245582:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184193792 00000100:00100000:0.0:1788581351.245627:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788581351.245637:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184193792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581351.245667:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581351.246406:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184193792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 769us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581351.246428:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788581351.246482:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184193792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581351.752443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581351.752751:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497152 00000100:00100000:3.0:1788581351.752764:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497152 00000100:00100000:3.0:1788581351.752899:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:3.0:1788581351.752929:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:12175:x1875463170497152:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581351.752958:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581351.752986:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221b5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753088:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753107:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753144:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753162:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753170:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753177:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753244:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753286:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753294:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753301:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581351.753307:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753316:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753331:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581351.753335:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581351.753342:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753357:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b3058f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753372:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753379:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753385:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753390:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581351.753394:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753400:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753409:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff995e6f934900) 00010000:00010000:3.0:1788581351.753412:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581351.753415:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753421:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753459:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30588 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221b5 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753500:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581351.753502:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581351.753507:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221b5 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.753518:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581351.753608:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:12175:x1875463170497152:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 697us (1180us total) trans 0 rc 301/301 00000100:00100000:3.0:1788581351.753616:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00080000:0.0:1788581351.753991:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581351.762383:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581351.762788:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497408 00000100:00100000:3.0:1788581351.762807:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497408 00000100:00100000:3.0:1788581351.763165:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:3.0:1788581351.763182:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+14:12175:x1875463170497408:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:3.0:1788581351.763309:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581351.763348:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b2fedc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fd9 expref: 14 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.763379:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581351.763387:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581351.763465:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.763493:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.763504:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.763576:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.763594:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 5 pid: 6494 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581351.763613:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184193920:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581351.763782:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581351.767535:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581351.767726:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184193920:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581351.767769:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581351.768033:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497536 00000100:00100000:1.0:1788581351.768051:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497536 00010000:00010000:1.0:1788581351.768123:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 6 pid: 6494 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581351.768188:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1788581351.768204:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2395:x1875463170497536:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581351.768223:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581351.768231:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 6 pid: 6494 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.768247:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 6 pid: 6494 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.769408:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b3055e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221a7 expref: 6 pid: 6494 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.769439:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:1.0:1788581351.769445:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.769457:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.769464:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.769518:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581351.769595:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2395:x1875463170497536:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1395us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581351.769605:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00010000:00010000:3.0:1788581351.770472:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.770487:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.770515:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.770527:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.770538:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773727:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773764:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773779:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581351.773801:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097e7df21 reply state 000000009b2d2749 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773812:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773820:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581351.773823:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581351.773829:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788581351.773836:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788581351.773847:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773855:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773862:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773869:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581351.773874:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773882:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.773906:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e7a659100) 00010000:00010000:3.0:1788581351.774242:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581351.774249:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.774869:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3059d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581351.774899:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097e7df21 reply state 000000009b2d2749 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.774989:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.774999:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff995e6f934500) 00010000:00010000:3.0:1788581351.775001:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581351.775005:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788581351.775357:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:12175:x1875463170497408:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 12175us (12980us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788581351.775367:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:0.0:1788581351.877146:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581351.877314:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497664 00000100:00100000:1.0:1788581351.877332:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497664 00000100:00100000:1.0:1788581351.877438:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:1.0:1788581351.877454:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+15:12183:x1875463170497664:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:1.0:1788581351.877512:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581351.877548:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b305b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221bc expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877651:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877669:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877687:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581351.877753:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581351.877757:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581351.877786:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877818:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b305b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221bc expref: 17 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877866:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221bc expref: 16 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.877876:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:1.0:1788581351.877880:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581351.877884:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6aa00, rc 0) 00000100:00100000:1.0:1788581351.878845:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12183:x1875463170497664:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 1386us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581351.878858:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:1.0:1788581351.964114:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581351.966135:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170497792 00000100:00100000:0.0:1788581351.966151:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170497792 00000100:00100000:0.0:1788581351.966337:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:0.0:1788581351.966349:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12189:x1875463170497792:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581351.966372:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581351.966397:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b305c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221c3 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966472:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966488:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966498:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966508:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966515:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966537:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966638:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966647:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966654:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581351.966697:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788581351.966701:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581351.966718:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966730:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966736:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966743:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966748:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581351.966752:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966759:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.966777:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:0.0:1788581351.966780:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581351.966785:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967154:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b305c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967172:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967177:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967182:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967187:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581351.967189:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967194:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967202:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff995e6f934500) 00010000:00010000:0.0:1788581351.967204:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581351.967206:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967211:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b305ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967249:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b305c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221c3 expref: 18 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967305:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221c3 expref: 17 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.967312:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581351.967314:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788581351.967316:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71400, rc 0) 00000100:00100000:0.0:1788581351.967403:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12189:x1875463170497792:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1055us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581351.967411:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:2.0:1788581351.973143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581351.973229:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498048 00000100:00100000:3.0:1788581351.973239:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498048 00000100:00100000:3.0:1788581351.973327:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:3.0:1788581351.973339:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12189:x1875463170498048:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581351.973359:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581351.973377:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b305dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221ca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973474:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973520:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973531:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973569:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973577:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.973583:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581351.973985:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788581351.974127:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974137:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974145:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974176:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974183:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974190:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974206:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581351.974211:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974217:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581351.974232:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581351.974237:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974243:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b305e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581351.974289:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002815248d reply state 000000004139ad26 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974302:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974308:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:3.0:1788581351.974311:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581351.974313:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581351.974341:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b305dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974355:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581351.974374:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:3.0:1788581351.974377:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581351.974379:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980400, rc 0) 00000100:00100000:3.0:1788581351.974445:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:12189:x1875463170498048:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1107us (1313us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788581351.974453:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:2.0:1788581351.983459:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581351.985840:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498176 00000100:00100000:0.0:1788581351.985854:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498176 00000100:00100000:0.0:1788581351.985933:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1788581351.985944:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170498176:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581351.985963:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581351.985983:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221d1 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581351.986006:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581351.986024:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1788581351.986029:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581351.986038:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 6 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.986087:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 6 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581351.986100:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71200, rc 0) 00000100:00100000:0.0:1788581351.986172:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2396:x1875463170498176:12345-192.168.203.3@tcp:101:bash.0 Request processed in 229us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581351.986179:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1788581351.991740:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581351.992159:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498304 00000100:00100000:1.0:1788581351.992175:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498304 00000100:00100000:1.0:1788581351.992384:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581351.992395:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:12189:x1875463170498304:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581351.992414:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581351.992433:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221d8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.992466:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.992513:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581351.992522:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581351.992531:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.992614:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581351.992636:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581351.992656:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1875463184194048:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581351.992778:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f938540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581351.998397:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581351.998581:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1875463184194048:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581351.998625:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581351.998652:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b400, rc 0) 00000100:00100000:2.0:1788581351.998737:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:12189:x1875463170498304:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6342us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581351.998748:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1788581352.000674:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498432 00000100:00100000:3.0:1788581352.000688:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498432 00010000:00010000:3.0:1788581352.000779:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581352.000831:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1788581352.001031:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170498432:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581352.001050:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581352.001087:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.001107:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.001135:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000018f86e0/0x50f0cc74b7b305ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d1 expref: 7 pid: 8408 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.001157:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581352.001180:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581352.001194:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.001225:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.001307:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581352.001326:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6478:1875463184194176:192.168.203.3@tcp:105: 00000100:00100000:3.0:1788581352.001416:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ced80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581352.004534:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6478:1875463184194176:192.168.203.3@tcp:105: 00010000:00010000:3.0:1788581352.004578:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581352.004706:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170498432:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3682us (6321us total) trans 0 rc 0/0 00000100:00080000:0.0:1788581352.004788:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581352.010236:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1788581352.010525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.011957:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498688 00000100:00100000:3.0:1788581352.011970:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498688 00000100:00100000:3.0:1788581352.012037:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:3.0:1788581352.012048:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:12189:x1875463170498688:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1788581352.012436:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12189:x1875463170498688:12345-192.168.203.3@tcp:35:bash.0 Request processed in 388us (1913us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788581352.012443:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:1.0:1788581352.107854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581352.110182:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170498944 00000100:00100000:0.0:1788581352.110207:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170498944 00000100:00100000:1.0:1788581352.112788:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:1.0:1788581352.113019:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12199:x1875463170498944:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581352.113055:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581352.113089:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3060d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221df expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581352.113213:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788581352.113447:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3060d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221df expref: 23 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.113465:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:1.0:1788581352.113468:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581352.113474:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3060d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221df expref: 23 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.113791:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:1.0:1788581352.114570:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12199:x1875463170498944:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1756us (6725us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788581352.114587:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:2.0:1788581352.128616:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.129166:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170499200 00000100:00100000:3.0:1788581352.129180:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170499200 00000100:00100000:3.0:1788581352.130781:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:3.0:1788581352.130811:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12199:x1875463170499200:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581352.131149:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12199:x1875463170499200:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 351us (2547us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788581352.131157:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00010000:00010000:2.0:1788581352.134051:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581352.214397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581352.214699:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170499328 00000100:00100000:0.0:1788581352.214709:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170499328 00000100:00100000:0.0:1788581352.214768:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:0.0:1788581352.214778:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12205:x1875463170499328:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581352.214803:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581352.214827:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b3061b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221e6 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.214898:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.214912:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.214922:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581352.214978:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788581352.214982:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581352.214997:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.215022:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b3061b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221e6 expref: 25 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.215039:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221e6 expref: 24 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.215047:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581352.215050:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581352.215053:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71200, rc 0) 00000100:00100000:0.0:1788581352.215122:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12205:x1875463170499328:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 345us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581352.215129:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:2.0:1788581352.232081:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.232191:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170499584 00000100:00100000:1.0:1788581352.232203:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170499584 00000100:00100000:1.0:1788581352.232340:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:1.0:1788581352.232352:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12205:x1875463170499584:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581352.232383:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581352.232405:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30629 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.232531:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.232545:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.232564:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581352.233235:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788581352.233384:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ed expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.233403:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ed expref: 26 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.233644:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:1.0:1788581352.233647:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581352.233650:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a000, rc 0) 00000100:00100000:1.0:1788581352.236853:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12205:x1875463170499584:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 4488us (4781us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788581352.236866:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:2.0:1788581352.254348:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581352.254474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.255070:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170499840 00000100:00100000:3.0:1788581352.255082:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170499840 00000100:00100000:3.0:1788581352.255161:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:3.0:1788581352.255173:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12205:x1875463170499840:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581352.255201:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581352.255225:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3063e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221f4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.255355:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.255370:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.255381:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581352.255393:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788581352.255509:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3063e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221f4 expref: 29 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.255527:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221f4 expref: 28 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.255564:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:3.0:1788581352.255567:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788581352.255572:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581352.255633:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:12205:x1875463170499840:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 462us (1297us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788581352.255640:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:0.0:1788581352.257518:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170499968 00000100:00100000:0.0:1788581352.257532:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170499968 00000100:00100000:0.0:1788581352.258096:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1788581352.258116:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:2393:x1875463170499968:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581352.258139:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581352.258180:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ed expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.258208:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:0.0:1788581352.258235:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581352.258768:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:2393:x1875463170499968:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 655us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581352.258782:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581352.273138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581352.277783:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500096 00000100:00100000:0.0:1788581352.277800:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500096 00000100:00100000:0.0:1788581352.277866:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:0.0:1788581352.277877:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2395:x1875463170500096:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1788581352.277920:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.277940:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.277949:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581352.277955:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581352.277961:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.278012:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.278031:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 6 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581352.278049:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184194304:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581352.278183:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e41377000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581352.286989:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581352.287091:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500224 00000100:00100000:2.0:1788581352.287101:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500224 00002000:00100000:2.0:1788581352.287151:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff995d439dad80 x1875463170500224/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:708/0 lens 504/0 e 0 to 0 dl 1788581363 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581352.287162:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d439dad80 with x1875463170500224 ext(0->12) 00010000:00010000:2.0:1788581352.287171:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 7 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581352.287190:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 7 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581352.287199:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d439dad80 00000100:00100000:2.0:1788581352.287234:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1788581352.287244:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170500224:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:1.0:1788581352.288056:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875463184194304:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581352.288091:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581352.289510:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170500224:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 2261us (2526us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788581352.289523:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:2.0:1788581352.289535:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff995d439dad80 x1875463170500224/t4294967306(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:708/0 lens 504/448 e 0 to 0 dl 1788581363 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581352.289545:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d439dad80 with x1875463170500224 ext(0->12) 00010000:00010000:2.0:1788581352.289554:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581352.289572:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581352.289594:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d439dad80 00000100:00100000:1.0:1788581352.293388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581352.293787:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500352 00000100:00100000:2.0:1788581352.293864:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500352 00010000:00010000:2.0:1788581352.293905:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581352.294167:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1788581352.294181:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2393:x1875463170500352:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581352.294194:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788581352.294210:0:6478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788581352.294213:0:6478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788581352 00002000:00010000:3.0:1788581352.294216:0:6478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788581352 00002000:00010000:3.0:1788581352.294218:0:6478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788581352 00002000:00010000:3.0:1788581352.294221:0:6478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788581352.294227:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.294242:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.294311:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b30606 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df221d8 expref: 9 pid: 8410 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.294327:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581352.294346:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581352.294352:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.294361:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.294395:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581352.294442:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2393:x1875463170500352:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 264us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581352.294450:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00010000:00010000:1.0:1788581352.294512:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294521:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294537:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294545:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294553:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294565:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581352.294570:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294577:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294588:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.294596:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30653 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581352.294647:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170500096:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 16772us (21519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581352.294655:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581352.303117:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581352.303205:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500608 00000100:00100000:2.0:1788581352.303216:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500608 00000100:00100000:2.0:1788581352.303297:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1788581352.303307:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12205:x1875463170500608:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1788581352.303367:0:6497:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221f4 expref: 27 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581352.303539:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788581352.303572:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788581352.306221:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788581352.306359:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.306383:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.306393:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.306446:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.306467:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 31 pid: 6494 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581352.306514:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184194432:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581352.306652:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec240 going to sleep for 11 seconds 00000100:00100000:0.0:1788581352.315998:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184194432:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581352.316030:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581352.316365:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.316684:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500736 00000100:00100000:1.0:1788581352.316693:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500736 00010000:00010000:1.0:1788581352.316738:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 32 pid: 6494 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581352.316783:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:1.0:1788581352.316793:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:2396:x1875463170500736:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581352.316808:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581352.316827:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 32 pid: 6494 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316841:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 32 pid: 6494 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316866:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980400/0x50f0cc74b7b305f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df221ca expref: 32 pid: 6494 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316882:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:1.0:1788581352.316887:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316895:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316902:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.316933:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581352.316992:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+31:2396:x1875463170500736:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 201us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581352.317000:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00010000:00010000:2.0:1788581352.317023:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581352.317032:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581352.317159:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788581352.317314:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788581352.317409:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184194560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788581352.317465:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581352.318114:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581352.319560:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184194560 00000100:00100000:0.0:1788581352.319577:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184194560 00000100:00100000:0.0:1788581352.319949:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788581352.319960:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184194560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788581352.320145:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184194560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581352.320174:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:3.0:1788581352.320234:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581352.320355:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184194560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788581352.320641:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788581352.320940:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184194688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788581352.320983:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581352.321070:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581352.321110:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184194688 00000100:00100000:0.0:1788581352.321116:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184194688 00000100:00100000:0.0:1788581352.321156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788581352.321164:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6497:x1875463184194688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788581352.321488:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6497:x1875463184194688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 324us (504us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788581352.321503:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788581352.321601:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184194688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788581352.321647:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788581352.321682:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321692:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321716:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321723:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.321727:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321734:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321749:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:1.0:1788581352.321752:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788581352.321757:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.321764:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3065a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581352.321862:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788581352.322042:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788581352.322053:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338463797981ns, next at 339463796246ns, rc = 0 00000001:00080000:1.0:1788581352.322058:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788581352.322089:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934700) 00010000:00010000:1.0:1788581352.322096:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788581352.322104:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b30645 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221f4 expref: 35 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581352.322199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:12205:x1875463170500608:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 18893us (19089us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788581352.322215:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000020:00080000:1.0:1788581352.322219:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788581352.327133:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.327326:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170500864 00000100:00100000:1.0:1788581352.327340:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170500864 00000100:00100000:1.0:1788581352.327400:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:1.0:1788581352.327411:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:12205:x1875463170500864:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581352.327435:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581352.327458:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30661 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df221fb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.327515:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221fb expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.327530:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221fb expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.327561:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581352.327565:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581352.327568:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a400, rc 0) 00000100:00100000:1.0:1788581352.327630:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:12205:x1875463170500864:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 220us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581352.327637:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:2.0:1788581352.333829:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.333933:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170501120 00000100:00100000:3.0:1788581352.333942:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170501120 00000100:00100000:3.0:1788581352.334007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1788581352.334018:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:12205:x1875463170501120:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581352.334247:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:12205:x1875463170501120:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 231us (427us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788581352.334295:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1788581352.446564:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.447215:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170501376 00000100:00100000:1.0:1788581352.447225:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170501376 00000100:00100000:1.0:1788581352.447329:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:1.0:1788581352.447340:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+36:12215:x1875463170501376:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581352.447385:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581352.447403:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22202 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581352.447510:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788581352.447599:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30668 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22202 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.447613:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:1.0:1788581352.447616:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581352.447620:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22202 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.447634:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6bc00, rc 0) 00000100:00100000:1.0:1788581352.447703:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12215:x1875463170501376:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 365us (1148us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788581352.447710:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:2.0:1788581352.457122:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.461480:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170501504 00000100:00100000:1.0:1788581352.461498:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170501504 00000100:00100000:1.0:1788581352.461577:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:1.0:1788581352.461588:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12215:x1875463170501504:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:1.0:1788581352.461689:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461708:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461720:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461746:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461754:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461760:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461837:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461847:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461855:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581352.461903:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461917:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461923:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461930:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461936:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.461940:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461954:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461967:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581352.461970:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581352.461975:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461981:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30676 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.461995:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462000:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462005:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462010:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.462013:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462018:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462024:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:1.0:1788581352.462026:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581352.462029:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462042:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b3067d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462051:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462056:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462073:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462079:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.462082:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462087:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462096:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581352.462098:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581352.462101:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.462105:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581352.462186:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12215:x1875463170501504:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 599us (5073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581352.462194:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:2.0:1788581352.465078:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.465153:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170501760 00000100:00100000:3.0:1788581352.465163:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170501760 00000100:00100000:3.0:1788581352.465284:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1788581352.465297:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12215:x1875463170501760:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581352.465693:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:12215:x1875463170501760:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 398us (631us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788581352.465713:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1788581352.519502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.519714:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170502016 00000100:00100000:1.0:1788581352.519725:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170502016 00000100:00100000:1.0:1788581352.519791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:1.0:1788581352.519802:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:12218:x1875463170502016:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581352.519825:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581352.519844:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3068b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22209 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519916:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519931:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519942:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519952:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519959:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.519965:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520084:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520093:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520120:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581352.520130:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788581352.520200:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520208:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520214:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520219:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.520223:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520230:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520242:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581352.520245:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581352.520250:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520304:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520327:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520332:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520344:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520349:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581352.520351:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520356:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520364:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:1.0:1788581352.520366:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581352.520369:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520374:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520409:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b3068b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520423:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 40 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581352.520429:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581352.520431:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581352.520434:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581352.520705:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12218:x1875463170502016:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 904us (1218us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788581352.520722:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:2.0:1788581352.529844:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581352.529933:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170502144 00000100:00100000:3.0:1788581352.529943:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170502144 00000100:00100000:3.0:1788581352.530006:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:3.0:1788581352.530017:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12218:x1875463170502144:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1788581352.530096:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530113:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530126:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530159:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530166:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530173:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530180:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581352.530184:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530193:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530227:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581352.530230:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581352.530235:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.530241:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581352.530364:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12218:x1875463170502144:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 348us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581352.530372:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:0.0:1788581352.534379:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.534663:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170502400 00000100:00100000:1.0:1788581352.534674:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170502400 00000100:00100000:1.0:1788581352.534742:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:1.0:1788581352.534753:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12218:x1875463170502400:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1788581352.534995:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:12218:x1875463170502400:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 243us (625us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788581352.535003:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:1.0:1788581352.921706:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581352.921864:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170502656 00000100:00100000:0.0:1788581352.921876:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170502656 00000100:00100000:0.0:1788581352.921933:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:0.0:1788581352.921944:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:12250:x1875463170502656:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1788581352.921968:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581352.921987:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b306b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22210 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.922101:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b306bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.922117:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b306bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.922132:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b306bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581352.922142:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788581352.922243:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b306b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22210 expref: 44 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.922301:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b306bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22210 expref: 43 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581352.922309:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581352.922312:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581352.922315:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581352.922376:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12250:x1875463170502656:12345-192.168.203.3@tcp:101:cat.0 Request processed in 434us (680us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788581352.922383:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:2.0:1788581352.931136:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581352.931185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581352.931199:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170502912 00000100:00100000:1.0:1788581352.931210:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170502912 00000100:00100000:3.0:1788581352.931280:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503040 00000100:00100000:1.0:1788581352.931295:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581352.931296:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503040 00000100:00100000:1.0:1788581352.931308:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:12250:x1875463170502912:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:3.0:1788581352.931345:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1788581352.931355:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:2393:x1875463170503040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581352.931368:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581352.931392:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b306bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22210 expref: 44 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581352.931408:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581352.931413:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581352.931467:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:2393:x1875463170503040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581352.931485:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581352.931522:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12250:x1875463170502912:12345-192.168.203.3@tcp:35:cat.0 Request processed in 216us (393us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788581352.931530:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:1.0:1788581353.021782:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581353.021992:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503296 00000100:00100000:3.0:1788581353.022002:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503296 00000100:00100000:3.0:1788581353.022078:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00080000:0.0:1788581353.022090:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581353.022101:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12256:x1875463170503296:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1788581353.022127:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581353.022130:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581353.022153:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b30622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221e6 expref: 43 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022170:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581353.022174:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581353.022186:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22217 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022344:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022358:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022366:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022393:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.022407:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 43 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581353.022427:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184194816:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581353.022697:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581353.027162:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d42258700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184194816:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581353.027193:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581353.029165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.029389:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503424 00000100:00100000:0.0:1788581353.029399:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503424 00010000:00010000:0.0:1788581353.029438:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 44 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581353.029482:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:0.0:1788581353.029501:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45350450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:2393:x1875463170503424:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581353.029515:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581353.029522:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 44 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029535:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 44 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029566:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b306a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22209 expref: 44 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029600:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581353.029605:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029614:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029622:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.029651:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581353.029707:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45350450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:2393:x1875463170503424:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 207us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581353.029715:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00010000:00010000:1.0:1788581353.030028:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.030036:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581353.030072:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788581353.030203:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b306ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.030218:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.030226:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.030228:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581353.030230:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980200, rc 0) 00000100:00100000:1.0:1788581353.030315:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12256:x1875463170503296:12345-192.168.203.3@tcp:101:dd.0 Request processed in 8217us (8543us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788581353.030323:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:3.0:1788581353.036678:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.037779:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503552 00000100:00100000:0.0:1788581353.037857:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503552 00000100:00100000:0.0:1788581353.037929:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:0.0:1788581353.037940:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12256:x1875463170503552:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1788581353.037962:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581353.037983:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b306df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2221e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038016:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038028:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038039:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038168:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b306df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 45 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038184:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.038193:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581353.038196:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581353.038200:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581353.038303:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d42258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:12256:x1875463170503552:12345-192.168.203.3@tcp:101:dd.0 Request processed in 365us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581353.038310:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:2.0:1788581353.045177:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581353.045918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503808 00000100:00100000:3.0:1788581353.045929:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503808 00000100:00100000:3.0:1788581353.046038:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:3.0:1788581353.046049:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4303b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:12256:x1875463170503808:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:3.0:1788581353.046362:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.046379:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.046391:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581353.046437:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788581353.046471:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018f6bcc3 reply state 000000007618591b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.046484:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.046492:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581353.046494:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581353.046499:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581353.046610:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4303b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:12256:x1875463170503808:12345-192.168.203.3@tcp:36:dd.0 Request processed in 562us (1441us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788581353.046617:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 170 00000020:00080000:3.0:1788581353.046621:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788581353.153424:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581353.281450:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581353.281473:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184195072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581353.281566:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581353.281640:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184195072 00000100:00100000:3.0:1788581353.281649:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184195072 00000100:00100000:3.0:1788581353.281723:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788581353.281733:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184195072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581353.281756:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788581353.281816:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184195072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581353.281825:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788581353.281862:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184195072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581353.282514:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184194944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581353.282555:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581353.282765:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184194944 00000100:00100000:0.0:1788581353.282772:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184194944 00000100:00100000:0.0:1788581353.282831:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788581353.282841:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184194944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581353.282856:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581353.282904:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184194944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581353.282911:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788581353.283061:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581353.285094:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184194944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581353.368543:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.368976:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170503936 00000100:00100000:1.0:1788581353.368987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170503936 00000100:00100000:1.0:1788581353.369069:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:1.0:1788581353.369080:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:12269:x1875463170503936:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:1.0:1788581353.369106:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581353.369128:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b306f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22225 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369196:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369235:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369248:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369305:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369321:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369388:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369399:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369407:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369438:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.369896:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 48 pid: 6493 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581353.369925:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184195200:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581353.370023:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581353.378145:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.378402:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184195200:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581353.378428:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581353.378547:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170504192 00000100:00100000:3.0:1788581353.378562:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170504192 00000100:00100000:0.0:1788581353.378891:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1788581353.378908:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:6160:x1875463170504192:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788581353.379400:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:6160:x1875463170504192:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 493us (1260us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788581353.379430:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1788581353.382187:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581353.383285:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170504320 00000100:00100000:2.0:1788581353.383301:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170504320 00010000:00010000:2.0:1788581353.383352:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 50 pid: 6493 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581353.383409:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:2.0:1788581353.383420:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:2395:x1875463170504320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581353.383436:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581353.383443:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 50 pid: 6493 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383475:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 50 pid: 6493 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383496:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980200/0x50f0cc74b7b306d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22217 expref: 50 pid: 6493 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383514:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:2.0:1788581353.383520:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383530:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383537:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581353.383570:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581353.383693:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+49:2395:x1875463170504320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 274us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581353.383701:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00010000:00010000:1.0:1788581353.384010:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384019:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581353.384082:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788581353.384087:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581353.384110:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384123:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384132:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384138:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384144:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384149:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581353.384161:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384168:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384179:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581353.384181:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581353.384184:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384190:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b306fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384202:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384209:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384216:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384222:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581353.384225:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384231:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384237:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:1.0:1788581353.384239:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581353.384250:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384824:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384868:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b306f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22225 expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384883:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22225 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.384892:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.384894:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581353.384897:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6bc00, rc 0) 00000100:00100000:1.0:1788581353.384959:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:12269:x1875463170503936:12345-192.168.203.3@tcp:101:stat.0 Request processed in 15880us (16425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581353.384968:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:3.0:1788581353.452363:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.455608:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170504576 00000100:00100000:1.0:1788581353.455624:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170504576 00000100:00100000:1.0:1788581353.455748:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:1.0:1788581353.455759:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:12276:x1875463170504576:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:1.0:1788581353.455819:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581353.455848:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22225 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.455869:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.456012:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581353.456212:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.456228:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.456239:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581353.456359:0:11562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788581353.456381:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6be687f reply state 00000000cd69f92a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.456394:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.456400:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.456403:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581353.456405:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581353.456525:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:12276:x1875463170504576:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 766us (4172us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788581353.456531:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000020:00080000:1.0:1788581353.456536:0:11562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581353.649840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581353.649995:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170504704 00000100:00100000:3.0:1788581353.650014:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170504704 00000100:00100000:3.0:1788581353.650118:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:3.0:1788581353.650130:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+50:12290:x1875463170504704:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:3.0:1788581353.650166:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581353.650197:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2222c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650360:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650380:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650397:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650412:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650443:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650450:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650569:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650580:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650587:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581353.650660:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788581353.650665:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581353.650691:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650707:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650717:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650724:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650730:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650748:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581353.650754:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650762:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650779:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581353.650782:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581353.650788:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650795:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3071e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650812:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650818:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650824:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650829:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581353.650832:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650838:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650857:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:3.0:1788581353.650859:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581353.650863:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650868:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650906:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 52 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650921:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 51 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.650929:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581353.650932:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581353.650935:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981c00, rc 0) 00000100:00100000:3.0:1788581353.651039:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:12290:x1875463170504704:12345-192.168.203.3@tcp:101:stat.0 Request processed in 910us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581353.651048:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:2.0:1788581353.768657:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.768742:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170504960 00000100:00100000:1.0:1788581353.768754:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170504960 00000100:00100000:1.0:1788581353.768827:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:1.0:1788581353.768838:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:12300:x1875463170504960:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581353.768863:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581353.768895:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22233 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581353.769046:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788581353.769183:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30733 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22233 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.769201:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:1.0:1788581353.769204:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581353.769210:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22233 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.769228:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6bc00, rc 0) 00000100:00100000:1.0:1788581353.769354:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:12300:x1875463170504960:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 517us (707us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788581353.769362:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:2.0:1788581353.771743:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.771873:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170505216 00000100:00100000:0.0:1788581353.771886:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170505216 00000100:00100000:0.0:1788581353.771961:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1788581353.771975:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:12300:x1875463170505216:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581353.772350:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:12300:x1875463170505216:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 377us (617us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788581353.772358:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1788581353.793524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184195328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581353.793615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581353.793934:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184195328 00000100:00100000:0.0:1788581353.793944:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184195328 00000100:00100000:0.0:1788581353.794003:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788581353.794013:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184195328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581353.794047:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788581353.794228:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184195328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 215us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581353.794235:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788581353.794443:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184195328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581353.834415:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.837368:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170505472 00000100:00100000:1.0:1788581353.837389:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170505472 00000100:00100000:1.0:1788581353.837478:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 175 00000100:00100000:1.0:1788581353.837492:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+53:12306:x1875463170505472:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581353.837528:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581353.837551:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30741 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2223a expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.837686:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.837718:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 54 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.837727:0:11562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.837767:0:11562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 54 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.837782:0:11562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 54 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581353.837797:0:11562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184195456:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581353.837925:0:11562:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581353.843185:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.843297:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170505600 00000100:00100000:0.0:1788581353.843309:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170505600 00010000:00010000:0.0:1788581353.843369:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 55 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581353.843419:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:0.0:1788581353.843434:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:2395:x1875463170505600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581353.843465:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581353.843475:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 55 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.843528:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 55 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.843551:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581353.843557:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.843567:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.843575:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.843596:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581353.843658:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:2395:x1875463170505600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 229us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581353.843775:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00010000:00010000:1.0:1788581353.847049:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981c00/0x50f0cc74b7b3072c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2222c expref: 54 pid: 6494 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581353.847618:0:11562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11562:1875463184195456:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581353.847653:0:11562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.847676:0:11562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.847682:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581353.847710:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788581353.847889:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b30741 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 55 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.847908:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 54 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.847918:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.847921:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581353.847924:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:1.0:1788581353.848010:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:12306:x1875463170505472:12345-192.168.203.3@tcp:101:bash.0 Request processed in 10520us (13610us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788581353.848019:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 175 00000100:00100000:2.0:1788581353.853060:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.853196:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170505856 00000100:00100000:0.0:1788581353.853212:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170505856 00000100:00100000:0.0:1788581353.853353:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 176 00000100:00100000:0.0:1788581353.853367:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:12306:x1875463170505856:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1788581353.853726:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.853754:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.853769:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581353.853855:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788581353.853883:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc1ae40c reply state 0000000026acb0a9 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.853900:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581353.853908:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581353.853911:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581353.853917:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581353.854035:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:12306:x1875463170505856:12345-192.168.203.3@tcp:36:bash.0 Request processed in 670us (999us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788581353.854044:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 176 00000020:00080000:0.0:1788581353.854060:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581353.863632:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581353.863828:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170505984 00000100:00100000:1.0:1788581353.863845:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170505984 00000100:00100000:1.0:1788581353.863958:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:1.0:1788581353.863972:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:12306:x1875463170505984:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581353.864005:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581353.864032:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3075d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22241 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.864395:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.864414:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 58 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.864423:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.864473:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 58 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.864488:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 58 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581353.864503:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184195584:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581353.864606:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581353.875332:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184195584:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581353.875368:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581353.877594:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581353.880036:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170506112 00000100:00100000:3.0:1788581353.880173:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170506112 00010000:00010000:3.0:1788581353.880245:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 59 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581353.880655:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:3.0:1788581353.880940:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:2395:x1875463170506112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581353.881016:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581353.881036:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 59 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881088:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 59 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881147:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b30748 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2223a expref: 59 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881180:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581353.881185:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881196:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881203:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581353.881346:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581353.881840:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:2395:x1875463170506112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 929us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581353.881850:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00010000:00010000:1.0:1788581353.882813:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.882828:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581353.882894:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788581353.882899:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581353.882921:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.882966:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3075d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22241 expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.882988:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22241 expref: 57 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581353.883018:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581353.883021:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581353.883025:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581353.883099:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:12306:x1875463170505984:12345-192.168.203.3@tcp:101:bash.0 Request processed in 19130us (19482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581353.883107:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:2.0:1788581353.885813:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581353.885926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170506368 00000100:00100000:0.0:1788581353.885936:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170506368 00000100:00100000:0.0:1788581353.886027:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1788581353.886040:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+57:12306:x1875463170506368:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:0.0:1788581353.887042:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12306:x1875463170506368:12345-192.168.203.3@tcp:35:bash.0 Request processed in 997us (1234us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788581353.887067:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:2.0:1788581354.026654:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.026770:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170506624 00000100:00100000:1.0:1788581354.026781:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170506624 00000100:00100000:1.0:1788581354.026961:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:1.0:1788581354.026974:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12316:x1875463170506624:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581354.027002:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581354.027025:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3076b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22248 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581354.027162:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788581354.027312:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3076b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22248 expref: 60 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.027328:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:1.0:1788581354.027331:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581354.027337:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3076b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22248 expref: 60 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.027352:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6bc00, rc 0) 00000100:00100000:1.0:1788581354.027422:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12316:x1875463170506624:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 450us (777us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788581354.027452:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:2.0:1788581354.033755:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.035331:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170506752 00000100:00100000:3.0:1788581354.035355:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170506752 00000100:00100000:3.0:1788581354.035471:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:3.0:1788581354.035487:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12316:x1875463170506752:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1788581354.035647:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035671:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035687:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035703:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035711:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035717:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035836:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035846:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035854:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581354.035925:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035943:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035961:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035969:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035976:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.035981:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.035989:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036005:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581354.036008:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.036015:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036022:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036042:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036059:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036066:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036080:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.036090:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036096:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036105:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:3.0:1788581354.036108:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.036111:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036118:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036129:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036135:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036141:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036146:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.036149:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036156:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036163:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581354.036166:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.036175:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.036182:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.036396:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12316:x1875463170506752:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 909us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.036407:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:2.0:1788581354.046858:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.046985:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170507008 00000100:00100000:3.0:1788581354.047004:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170507008 00000100:00100000:3.0:1788581354.047245:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1788581354.047290:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12316:x1875463170507008:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581354.048214:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:12316:x1875463170507008:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 947us (1363us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788581354.048228:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:0.0:1788581354.103076:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.103223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170507264 00000100:00100000:1.0:1788581354.103244:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170507264 00000100:00100000:1.0:1788581354.103385:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:1.0:1788581354.103398:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:12319:x1875463170507264:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581354.103433:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581354.103458:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3078e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2224f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103549:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103569:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103583:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103598:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103606:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103612:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103753:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5a00/0x50f0cc74b7b307a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103787:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5a00/0x50f0cc74b7b307a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103794:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5a00/0x50f0cc74b7b307a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581354.103805:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788581354.103904:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103911:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103917:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103923:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.103928:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103936:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103949:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581354.103952:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.103957:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103964:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b30795 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103978:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103990:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.103996:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104001:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.104005:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104011:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104019:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:1.0:1788581354.104022:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.104025:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104031:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3079c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104084:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b3078e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2224f expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104100:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5a00/0x50f0cc74b7b307a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2224f expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.104107:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.104110:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581354.104118:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5a00, rc 0) 00000100:00100000:1.0:1788581354.104201:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12319:x1875463170507264:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 805us (1153us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788581354.104210:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:2.0:1788581354.110433:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581354.110483:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.111204:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170507392 00000100:00100000:0.0:1788581354.111220:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170507392 00000100:00100000:0.0:1788581354.111362:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1788581354.111375:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12319:x1875463170507392:12345-192.168.203.3@tcp:54:lfs.0 00000100:00100000:3.0:1788581354.111447:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170507520 00000100:00100000:3.0:1788581354.111452:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170507520 00010000:00010000:0.0:1788581354.111479:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.111518:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1788581354.111525:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:2396:x1875463170507520:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581354.111525:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.111541:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581354.111542:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.111567:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5a00/0x50f0cc74b7b307a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2224f expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.111588:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581354.111594:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.111595:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581354.111601:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.111608:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.111614:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581354.111619:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.111627:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.111635:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581354.111638:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581354.111641:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.111647:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b307b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.111672:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:2396:x1875463170507520:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 147us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.111681:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12319:x1875463170507392:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 310us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.111691:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1788581354.111692:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1788581354.115744:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.116666:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170507776 00000100:00100000:0.0:1788581354.116683:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170507776 00000100:00100000:0.0:1788581354.117454:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:0.0:1788581354.117615:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:12319:x1875463170507776:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581354.117945:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12319:x1875463170507776:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 478us (2217us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788581354.117955:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00010000:00010000:0.0:1788581354.177589:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581354.294396:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.294516:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508032 00000100:00100000:3.0:1788581354.294534:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508032 00000100:00100000:3.0:1788581354.294628:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:3.0:1788581354.294641:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12337:x1875463170508032:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1788581354.294678:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581354.294706:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b307b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22256 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.294859:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b307bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.294880:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b307bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.294895:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b307bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581354.294909:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788581354.295073:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b307b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22256 expref: 65 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.295097:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b307bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22256 expref: 64 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.295108:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581354.295112:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788581354.295116:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981600, rc 0) 00000100:00100000:3.0:1788581354.295230:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+64:12337:x1875463170508032:12345-192.168.203.3@tcp:101:cat.0 Request processed in 591us (850us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788581354.295239:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1788581354.336364:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.340325:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508160 00000100:00100000:1.0:1788581354.340358:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508160 00000100:00100000:1.0:1788581354.340495:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:1.0:1788581354.340512:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+64:12338:x1875463170508160:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581354.340556:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581354.340585:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2225d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340683:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340702:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340717:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581354.340787:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788581354.340792:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581354.340820:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340857:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2225d expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340884:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2225d expref: 65 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.340916:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581354.340920:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581354.340925:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5400, rc 0) 00000100:00100000:1.0:1788581354.341028:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12338:x1875463170508160:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 520us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.341036:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1788581354.347220:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.347561:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508544 00000100:00100000:0.0:1788581354.347578:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508544 00000100:00100000:0.0:1788581354.347659:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1788581354.347673:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12338:x1875463170508544:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581354.348818:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12338:x1875463170508544:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 1142us (1612us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788581354.348831:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000001:00080000:2.0:1788581354.353422:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1788581354.353498:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788581354.353525:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e51d63a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788581354.353530:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e71452d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e41377000 00000020:00080000:2.0:1788581354.353534:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e71452100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995d410a6800 00000020:00080000:2.0:1788581354.354167:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788581354.354318:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788581354.355066:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581354.355095:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184195712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788581354.355420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581354.355626:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184195712 00000100:00100000:2.0:1788581354.355638:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184195712 00000100:00080000:3.0:1788581354.355949:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581354.356108:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581354.356124:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184195712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788581354.356173:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788581354.356227:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b95e8, atime: 0x6a9b95e8, ctime: 0x6a9b95e8, blocks: 0x8 00010000:00010000:2.0:1788581354.356238:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356291:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788581354.356297:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581354.356325:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356347:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356361:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356370:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356395:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581354.356632:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184195712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 512us (1211us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788581354.356642:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788581354.356767:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581354.356776:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356785:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581354.356790:0:10311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356800:0:10311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356833:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356842:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f4b595/0x50f0cc74b7b307db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.356869:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581354.356871:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581354.356872:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581354.357134:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:3.0:1788581354.357623:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d423e7800/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788581354.357634:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184195712:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788581354.357845:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357858:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357866:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357872:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.357878:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357885:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357903:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff995e6f934500) 00010000:00010000:1.0:1788581354.357907:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.357912:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357918:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b305a4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357962:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357968:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357974:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357980:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.357983:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357989:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.357998:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581354.358001:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.358005:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358011:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b305ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358027:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358034:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358041:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358062:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.358065:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358071:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358081:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934900) 00010000:00010000:1.0:1788581354.358083:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.358086:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358093:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b305ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358111:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358118:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358123:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358128:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.358132:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358138:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358166:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.358168:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.358172:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358178:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b306ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358189:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358195:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358201:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358206:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.358209:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358215:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358221:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.358224:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.358226:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358232:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b30710 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358293:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358301:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358307:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358312:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.358315:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358321:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358330:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.358333:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.358335:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.358341:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30756 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581354.358523:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508672 00000100:00100000:2.0:1788581354.358535:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508672 00000100:00100000:2.0:1788581354.358618:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1788581354.358630:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12338:x1875463170508672:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:2.0:1788581354.358648:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788581354.358869:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b30764 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22241 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.358889:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b307bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22256 expref: 18 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.358903:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b30661 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221fb expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.358914:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:2.0:1788581354.358918:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581354.358993:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12338:x1875463170508672:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 365us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581354.359009:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1788581354.364166:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.365108:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508800 00000100:00100000:1.0:1788581354.365125:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508800 00000100:00100000:1.0:1788581354.365221:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:1.0:1788581354.365238:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12338:x1875463170508800:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:1.0:1788581354.365417:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.365459:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.365476:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581354.365620:0:11562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788581354.365734:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12338:x1875463170508800:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 501us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.365743:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:3.0:1788581354.398061:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.398318:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170508928 00000100:00100000:0.0:1788581354.398333:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170508928 00000100:00100000:0.0:1788581354.398429:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1788581354.398442:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+16:12340:x1875463170508928:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581354.398474:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581354.398517:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b307e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22264 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398643:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398662:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398678:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398698:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398706:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398713:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398827:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398837:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398844:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581354.398899:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788581354.398905:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581354.398932:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398959:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398969:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398976:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398983:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.398989:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581354.398995:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399004:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399019:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581354.399022:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581354.399201:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399211:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b307f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399231:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399237:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399251:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399338:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581354.399342:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399349:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399358:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233d800) 00010000:00010000:0.0:1788581354.399361:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581354.399364:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399370:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b307f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399424:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b307e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399440:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.399449:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581354.399451:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581354.399454:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70600, rc 0) 00000100:00100000:0.0:1788581354.399549:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12340:x1875463170508928:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1109us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.399568:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000040:00080000:2.0:1788581354.433661:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581354.433756:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581354.433801:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788581354.433814:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581354.434015:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184195840:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581354.434172:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47fb0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581354.443083:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.443535:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170509056 00000100:00100000:1.0:1788581354.443548:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170509056 00000100:00100000:1.0:1788581354.443643:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:1.0:1788581354.443656:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509056:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581354.443707:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581354.443879:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509056:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 225us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.443888:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:2.0:1788581354.443903:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184195840:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581354.467214:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.467419:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170509184 00000100:00100000:3.0:1788581354.467435:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170509184 00000100:00100000:3.0:1788581354.467544:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:3.0:1788581354.467557:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12344:x1875463170509184:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788581354.467664:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467692:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467707:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467729:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467738:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467775:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467822:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467834:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467842:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581354.467918:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788581354.467924:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581354.467945:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467960:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467968:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467977:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467984:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.467990:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.467998:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468025:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:3.0:1788581354.468028:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.468034:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468041:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30805 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468067:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468074:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468080:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468086:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.468089:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468094:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468102:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.468105:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.468108:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468114:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3080c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468143:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468149:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468156:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468161:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.468164:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468171:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468179:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581354.468182:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581354.468185:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.468191:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.468350:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12344:x1875463170509184:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 794us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.468359:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:3.0:1788581354.477016:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.477363:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170509440 00000100:00100000:0.0:1788581354.477379:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170509440 00000100:00100000:0.0:1788581354.477468:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:0.0:1788581354.477491:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+17:12344:x1875463170509440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581354.477524:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581354.477560:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3081a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2226b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.477887:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.477910:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.477925:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581354.477940:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788581354.478093:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478102:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478109:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478115:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581354.478145:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478153:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478171:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:0.0:1788581354.478175:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581354.478180:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478187:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478246:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3081a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2226b expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478343:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:0.0:1788581354.478345:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581354.478350:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3081a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2226b expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.478361:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71e00, rc 0) 00000100:00100000:0.0:1788581354.478461:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 982us (1467us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788581354.478471:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:2.0:1788581354.484321:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.484502:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170509568 00000100:00100000:0.0:1788581354.484517:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170509568 00000100:00100000:0.0:1788581354.484594:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1788581354.484606:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509568:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788581354.484699:0:11562:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788581354.484890:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509568:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 284us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.484899:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:3.0:1788581354.491955:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.492250:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170509824 00000100:00100000:0.0:1788581354.492310:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170509824 00000100:00100000:0.0:1788581354.492393:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:0.0:1788581354.492405:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170509824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581354.492438:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581354.492442:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788581354.492491:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b307d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2225d expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.492521:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581354.492526:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581354.492545:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3082f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22272 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581354.493126:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788581354.493379:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.493403:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.493416:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.493507:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b3082f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22272 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.493525:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22272 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.493534:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995d4233d800) 00010000:00010000:0.0:1788581354.493537:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581354.493542:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70e00, rc 0) 00000100:00100000:0.0:1788581354.493629:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170509824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1226us (1689us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788581354.493640:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1788581354.503377:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.503520:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510080 00000100:00100000:1.0:1788581354.503534:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510080 00000100:00100000:1.0:1788581354.503609:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1788581354.503622:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170510080:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581354.503729:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581354.503771:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22272 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503799:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995d4233d800) 00010000:00010000:1.0:1788581354.503834:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581354.503867:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503884:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503896:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503911:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503918:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503925:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503988:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.503996:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504004:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504012:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.504017:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504026:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504043:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581354.504055:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.504060:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504067:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b30844 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504079:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504085:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504091:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504096:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.504099:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504105:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504113:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9a2998fe (ffff995e51bef100) 00010000:00010000:1.0:1788581354.504116:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.504119:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.504125:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b3084b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9a2998fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.504249:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170510080:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 628us (889us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581354.504310:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1788581354.513337:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.518922:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510208 00000100:00100000:3.0:1788581354.518981:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510208 00000100:00100000:3.0:1788581354.519195:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:3.0:1788581354.519211:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12344:x1875463170510208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581354.519245:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581354.519323:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30852 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22279 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.519384:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.519402:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.519417:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.520192:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 20 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.520221:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 19 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.520233:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.520237:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581354.520240:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981000, rc 0) 00000100:00100000:3.0:1788581354.520618:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170510208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1409us (7296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.520627:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1788581354.527024:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.527659:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510464 00000100:00100000:3.0:1788581354.527704:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510464 00000100:00100000:3.0:1788581354.527799:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:3.0:1788581354.527812:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170510464:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581354.528113:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.528153:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.528168:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581354.528432:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788581354.528444:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340670189128ns, next at 341670186480ns, rc = 0 00000004:00010000:3.0:1788581354.528507:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ff1e341 reply state 00000000d49456e4 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.528521:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.528529:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.528532:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788581354.528537:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581354.528663:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12344:x1875463170510464:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 849us (1653us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788581354.528673:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1788581354.534139:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.534305:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510592 00000100:00100000:0.0:1788581354.534320:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510592 00000100:00100000:0.0:1788581354.534412:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:0.0:1788581354.534428:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12344:x1875463170510592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581354.534481:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581354.534512:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22280 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.534596:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 22 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.534616:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 22 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.534670:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:0.0:1788581354.534674:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581354.534694:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581354.534774:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12344:x1875463170510592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 350us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.534781:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:0.0:1788581354.543342:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.544842:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510720 00000100:00100000:3.0:1788581354.544866:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510720 00000100:00100000:3.0:1788581354.544986:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1788581354.545001:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+6:2394:x1875463170510720:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788581354.545054:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581354.545399:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2394:x1875463170510720:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 401us (2141us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788581354.545407:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1788581354.552794:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.561525:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170510976 00000100:00100000:3.0:1788581354.561549:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170510976 00000100:00100000:3.0:1788581354.561651:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1788581354.561669:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12344:x1875463170510976:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581354.562157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12344:x1875463170510976:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 491us (9379us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788581354.562168:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1788581354.573450:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.576318:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170511232 00000100:00100000:3.0:1788581354.576343:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170511232 00000100:00100000:3.0:1788581354.576449:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:3.0:1788581354.576461:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12344:x1875463170511232:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581354.576634:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12344:x1875463170511232:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 173us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.576642:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:0.0:1788581354.587166:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.587354:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170511360 00000100:00100000:1.0:1788581354.587370:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170511360 00000100:00100000:1.0:1788581354.587455:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:1.0:1788581354.587477:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12344:x1875463170511360:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581354.587521:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581354.587553:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b3086e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22287 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587654:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587671:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587685:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581354.587742:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581354.587777:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587812:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4400/0x50f0cc74b7b3086e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22287 expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587840:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22287 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.587850:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:1.0:1788581354.587853:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788581354.587857:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5000, rc 0) 00000100:00100000:1.0:1788581354.588206:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12344:x1875463170511360:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 738us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.588215:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:1.0:1788581354.598036:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.605641:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170511488 00000100:00100000:0.0:1788581354.605668:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170511488 00000100:00100000:0.0:1788581354.607235:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1788581354.607280:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2395:x1875463170511488:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581354.607313:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581354.607347:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2228e expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581354.607392:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b95ea, blocks: 0x0 00010000:00010000:0.0:1788581354.607424:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788581354.607430:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581354.607444:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.607468:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.607507:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581354.607611:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170511488:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 357us (9862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.607619:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1788581354.614724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.614775:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170511744 00000100:00100000:3.0:1788581354.614788:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170511744 00000100:00100000:3.0:1788581354.614862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:3.0:1788581354.614877:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12344:x1875463170511744:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581354.616357:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12344:x1875463170511744:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 1469us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.616400:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:1.0:1788581354.625757:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.625810:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170511872 00000100:00100000:1.0:1788581354.625824:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170511872 00000100:00100000:1.0:1788581354.625909:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1788581354.625922:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:12344:x1875463170511872:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581354.625949:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581354.625978:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22295 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.626028:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.626039:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581354.626053:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581354.626061:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.626131:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.626149:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.626167:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184195968:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581354.626973:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581354.632621:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184195968:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581354.632748:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.632778:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5e00, rc 0) 00000100:00100000:1.0:1788581354.632870:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:12344:x1875463170511872:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 6948us (7129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.632882:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1788581354.633042:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.633918:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512000 00000100:00100000:1.0:1788581354.633931:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512000 00010000:00010000:1.0:1788581354.633985:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.634040:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:1.0:1788581354.634062:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170512000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581354.634116:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581354.634146:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.634164:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.634200:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b3087c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2228e expref: 9 pid: 8906 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.634218:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581354.634224:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581354.634492:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.634508:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.634559:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.634577:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875463184196096:192.168.203.3@tcp:105: 00000100:00100000:1.0:1788581354.634748:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581354.637191:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875463184196096:192.168.203.3@tcp:105: 00010000:00010000:1.0:1788581354.637225:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581354.637339:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170512000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3278us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.637354:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:2.0:1788581354.643063:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.644649:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512128 00000100:00100000:3.0:1788581354.644670:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512128 00002000:00100000:3.0:1788581354.644757:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff995e7fb36a00 x1875463170512128/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:710/0 lens 504/0 e 0 to 0 dl 1788581365 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581354.644772:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995e7fb36a00 with x1875463170512128 ext(0->8) 00002000:00010000:3.0:1788581354.644780:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995e7fb36a00 00000100:00100000:3.0:1788581354.644830:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581354.644842:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170512128:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788581354.658109:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2395:x1875463170512128:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 13250us (15053us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788581354.658130:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00002000:00100000:1.0:1788581354.658149:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff995e7fb36a00 x1875463170512128/t4294967315(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:710/0 lens 504/448 e 0 to 0 dl 1788581365 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581354.658162:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995e7fb36a00 with x1875463170512128 ext(0->8) 00002000:00010000:1.0:1788581354.658170:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995e7fb36a00 00000100:00100000:2.0:1788581354.662811:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.662937:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512256 00000100:00100000:3.0:1788581354.662955:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512256 00000100:00100000:3.0:1788581354.663041:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:3.0:1788581354.663070:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12344:x1875463170512256:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788581354.665350:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788581354.665375:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788581354.665412:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788581354.665451:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788581354.665580:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788581354.665843:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581354.665876:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184196224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788581354.665965:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581354.666443:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666458:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666467:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666473:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.666478:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666627:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666649:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.666653:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788581354.666660:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.666668:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30860 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.666713:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184196224 00000100:00100000:3.0:1788581354.666722:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184196224 00000100:00100000:3.0:1788581354.666801:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788581354.666812:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184196224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788581354.666853:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170512256:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 3784us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581354.666867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 198 00002000:00010000:3.0:1788581354.666958:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788581354.666963:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788581354 00002000:00010000:3.0:1788581354.666966:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788581354.666968:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788581354 -> 1788581354 00002000:00010000:3.0:1788581354.666971:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788581354.667071:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184196224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (1104us total) trans 4294967316 rc 0/0 00000100:00080000:0.0:1788581354.667079:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581354.667080:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1788581354.667147:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d43bbc000/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788581354.667154:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184196224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788581354.671897:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581354.672068:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512384 00000100:00100000:2.0:1788581354.672079:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512384 00000100:00100000:2.0:1788581354.672139:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581354.672151:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2396:x1875463170512384:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788581354.673819:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788581354.673830:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1788581354.674137:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170512384:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 1984us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581354.674153:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1788581354.680069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.681828:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512640 00000100:00100000:0.0:1788581354.681844:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512640 00000100:00100000:0.0:1788581354.681989:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1788581354.682003:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170512640:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581354.682103:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581354.682135:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5000/0x50f0cc74b7b30875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22287 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.682156:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:0.0:1788581354.682161:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581354.682202:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.682218:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.682227:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581354.682619:0:11562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000664c7921 reply state 000000002d836570 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.682651:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.682658:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:0.0:1788581354.682660:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581354.682663:0:11562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581354.682806:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:12344:x1875463170512640:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 804us (2744us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788581354.682814:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:3.0:1788581354.695821:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.696970:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170512768 00000100:00100000:0.0:1788581354.696984:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170512768 00000100:00100000:0.0:1788581354.697063:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:0.0:1788581354.697075:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170512768:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788581354.697323:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788581354.697328:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788581354 -> 1788581353 00002000:00010000:0.0:1788581354.697331:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788581352 00002000:00010000:0.0:1788581354.697333:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788581354 -> 1788581353 00002000:00010000:0.0:1788581354.697335:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788581354.697414:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170512768:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 340us (1604us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788581354.697422:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581354.701879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.701924:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513024 00000100:00100000:3.0:1788581354.701936:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513024 00000100:00100000:3.0:1788581354.702004:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:3.0:1788581354.702024:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:12344:x1875463170513024:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788581354.702132:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.702157:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 20 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.702170:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.702882:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 20 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.702901:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 20 pid: 9504 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.702924:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184196352:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581354.703083:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581354.707807:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581354.707918:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184196352:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581354.707947:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.708122:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513152 00000100:00100000:1.0:1788581354.708129:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513152 00010000:00010000:1.0:1788581354.708170:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 21 pid: 9504 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.708214:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:1.0:1788581354.708225:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45350850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:2396:x1875463170513152:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581354.708243:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581354.708334:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 21 pid: 9504 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708348:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 21 pid: 9504 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708442:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b30859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22279 expref: 21 pid: 9504 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708457:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:1.0:1788581354.708461:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708471:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708479:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.708509:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581354.708562:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708571:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708607:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708622:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708630:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708639:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581354.708648:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708658:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708672:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.708676:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788581354.708682:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.708691:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30891 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.708707:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45350850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:2396:x1875463170513152:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 480us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.708716:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:3.0:1788581354.708758:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170513024:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 6739us (6883us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788581354.708772:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:0.0:1788581354.713307:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.714106:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513280 00000100:00100000:3.0:1788581354.714119:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513280 00000100:00100000:3.0:1788581354.714217:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1788581354.714229:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2393:x1875463170513280:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788581354.714478:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.714512:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.714520:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581354.714524:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581354.714529:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.714781:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.714797:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 8 pid: 8409 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.714815:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184196480:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581354.714994:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581354.721835:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.721995:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184196480:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581354.722198:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.724492:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513408 00000100:00100000:1.0:1788581354.724506:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513408 00010000:00010000:0.0:1788581354.727601:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581354.727697:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:0.0:1788581354.727710:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170513408:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581354.727727:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581354.727754:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.727770:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.727795:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab91e904/0x50f0cc74b7b30883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22295 expref: 9 pid: 8409 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.727813:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581354.727817:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581354.727822:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.727831:0:7444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.727877:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581354.727935:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170513408:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 229us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581354.727958:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00010000:00010000:3.0:1788581354.731125:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731153:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731216:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731225:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731235:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731241:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581354.731247:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731282:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731310:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.731318:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30898 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.731983:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170513280:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 17748us (18675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.731995:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1788581354.746930:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581354.747091:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513664 00000100:00100000:2.0:1788581354.747103:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513664 00000100:00100000:2.0:1788581354.747164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:2.0:1788581354.747175:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12344:x1875463170513664:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581354.747285:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.747303:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.747312:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.747350:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.747572:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 19 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581354.747600:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184196608:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581354.747703:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47fb0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581354.750928:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184196608:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581354.750956:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581354.753998:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581354.754122:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513792 00000100:00100000:2.0:1788581354.754136:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513792 00010000:00010000:2.0:1788581354.754184:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 20 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581354.754231:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:2.0:1788581354.754242:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:2396:x1875463170513792:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581354.754297:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581354.754305:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 20 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754320:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 20 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754343:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b306e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2221e expref: 20 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754361:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:2.0:1788581354.754382:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754393:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754400:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.754702:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581354.754829:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:2396:x1875463170513792:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 587us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581354.754838:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00010000:00010000:3.0:1788581354.756829:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.756848:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.757207:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.757224:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 19 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.757234:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.757347:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 19 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.757364:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 19 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.757382:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184196736:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581354.757664:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581354.766405:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.766545:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170513920 00000100:00100000:1.0:1788581354.766557:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170513920 00010000:00010000:1.0:1788581354.766597:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 20 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.766681:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:1.0:1788581354.766693:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:2395:x1875463170513920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581354.766713:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581354.766722:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 20 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.766754:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 20 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.766782:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:1.0:1788581354.766787:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.766799:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.766805:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.766825:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581354.766903:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:2395:x1875463170513920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 211us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581354.766910:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00010000:00010000:3.0:1788581354.768822:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30867 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22280 expref: 19 pid: 11562 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.768865:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184196736:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581354.768896:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.769014:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581354.769027:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581354.769200:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788581354.770129:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788581354.770212:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788581354.771852:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1875463184196864:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788581354.771934:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581354.772068:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a41240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581354.772960:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184196864 00000100:00100000:2.0:1788581354.772970:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184196864 00000100:00100000:2.0:1788581354.773052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788581354.773069:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1875463184196864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581354.773290:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1875463184196864:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581354.773301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788581354.773462:0:6494:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788581354.773471:0:6494:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d43bbc000, transno 4294967316 00000100:00100000:3.0:1788581354.773506:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1875463184196864:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788581354.774170:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788581354.774318:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1875463184196992:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788581354.774404:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581354.774446:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581354.774570:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184196992 00000100:00100000:1.0:1788581354.774578:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184196992 00000100:00100000:1.0:1788581354.774628:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788581354.774637:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1875463184196992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788581354.774747:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6494:x1875463184196992:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (345us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788581354.774758:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788581354.774814:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1875463184196992:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788581354.774864:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774896:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774904:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774910:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.774916:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774923:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774940:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:1.0:1788581354.774943:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581354.774948:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774954:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774986:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.774995:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775003:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775009:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.775028:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775038:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775062:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.775066:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581354.775070:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775078:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4a00/0x50f0cc74b7b307e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775113:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775133:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775146:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775184:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.775204:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 22 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.775222:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184197120:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581354.775356:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581354.782135:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581354.782377:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1875463184197120:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581354.782414:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.782824:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514048 00000100:00100000:3.0:1788581354.782834:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514048 00010000:00010000:3.0:1788581354.782881:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 23 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581354.782957:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1788581354.782967:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2395:x1875463170514048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581354.782982:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581354.782992:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 23 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783006:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 23 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783035:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b307fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22264 expref: 23 pid: 6495 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783072:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:3.0:1788581354.783080:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783114:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783125:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.783177:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581354.783313:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2395:x1875463170514048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 342us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581354.783325:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00010000:00010000:1.0:1788581354.784902:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784915:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784929:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784936:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784943:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784949:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.784953:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784960:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784976:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.784979:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581354.784983:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.784990:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4000/0x50f0cc74b7b308ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785035:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785056:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785064:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785072:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581354.785077:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785086:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785102:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e47fbc500) 00010000:00010000:1.0:1788581354.785106:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788581354.785110:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581354.785118:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b3089f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581354.785428:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12344:x1875463170513664:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 38245us (38497us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788581354.785447:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000020:00080000:1.0:1788581354.785455:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788581354.786839:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581354.786850:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581354.788643:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788581354.788669:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581354.795015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581354.795207:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514304 00000100:00100000:3.0:1788581354.795221:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514304 00000100:00100000:1.0:1788581354.796070:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:1.0:1788581354.796093:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12344:x1875463170514304:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788581354.798961:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788581354.799013:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788581354.799090:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799110:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799121:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799130:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799136:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799142:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581354.799173:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581354.799567:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581354.799576:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.799582:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581354.799587:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.799594:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.799606:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:3.0:1788581354.799609:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788581354.799613:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.799618:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b308b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581354.799644:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581354.799645:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581354.799647:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581354.800734:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12344:x1875463170514304:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 4642us (5719us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788581354.800749:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000020:00080000:2.0:1788581354.800757:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581355.201909:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581355.256864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.256901:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.256940:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.256973:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.256993:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514816 00000100:00100000:1.0:1788581355.256996:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.257007:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514816 00000100:00100000:1.0:1788581355.257031:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.257068:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.257094:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514560 00000100:00100000:1.0:1788581355.257099:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514560 00000100:00100000:2.0:1788581355.257118:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514944 00000100:00100000:2.0:1788581355.257124:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514944 00000100:00100000:1.0:1788581355.257140:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515072 00000100:00100000:1.0:1788581355.257144:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515072 00000100:00100000:2.0:1788581355.257160:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:1.0:1788581355.257169:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514688 00000100:00100000:1.0:1788581355.257173:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514688 00000100:00100000:2.0:1788581355.257175:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170514816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581355.257190:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515200 00000100:00100000:1.0:1788581355.257194:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515200 00000100:00100000:1.0:1788581355.257209:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:1.0:1788581355.257218:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2396:x1875463170514560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581355.257289:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2396:x1875463170514560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 71us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.257298:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:2.0:1788581355.257299:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170514816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 93us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.257316:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:2.0:1788581355.257323:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:1.0:1788581355.257325:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170515072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581355.257350:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170515072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.257360:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1788581355.257361:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:1.0:1788581355.257380:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:1.0:1788581355.257386:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170514688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581355.257390:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170514944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581355.257426:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170514944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.257433:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170514688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.257440:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1788581355.257445:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:2.0:1788581355.257489:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:2.0:1788581355.257521:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170515200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581355.257573:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170515200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 76us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.257579:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00080000:2.0:1788581355.257645:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581355.257663:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581355.257666:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581355.257694:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170514432 00000100:00100000:2.0:1788581355.257698:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170514432 00000100:00100000:2.0:1788581355.263202:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 384 00000100:00100000:2.0:1788581355.263229:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170514432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581355.263357:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170514432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 139us (6383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.263365:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 384 00000100:00100000:3.0:1788581355.330645:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184197504:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.330737:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.330811:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184198016:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.330839:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.330862:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184198528:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.330883:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.330910:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788581355.330916:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184197632:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.330938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.330955:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184198144:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.330979:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.330996:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184198656:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331016:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.331083:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198016 00000100:00100000:3.0:1788581355.331092:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198016 00000100:00100000:3.0:1788581355.331149:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198528 00000100:00100000:3.0:1788581355.331152:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198528 00000100:00100000:3.0:1788581355.331172:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197632 00000100:00100000:3.0:1788581355.331174:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197632 00000100:00100000:3.0:1788581355.331191:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788581355.331199:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184198016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331296:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184198016:12345-0@lo:400:kworker.0 Request processed in 96us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.331313:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788581355.331335:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788581355.331341:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184198528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331373:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184198528:12345-0@lo:400:kworker.0 Request processed in 32us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.331379:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788581355.331390:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788581355.331395:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184197632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331423:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184197632:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.331428:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788581355.331447:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197504 00000100:00100000:3.0:1788581355.331450:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197504 00000100:00100000:3.0:1788581355.331475:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788581355.331483:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331515:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184197504:12345-0@lo:400:kworker.0 Request processed in 34us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.331522:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788581355.331568:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184197632:0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.331579:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184197504:0@lo:400:kworker.0 00010000:00080000:3.0:1788581355.331590:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43be1180 x1875463184198016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581355.331600:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184198016:0@lo:400:kworker.0 00010000:00080000:3.0:1788581355.331609:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43968380 x1875463184198528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581355.331625:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184198528:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.331779:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184197248:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.331824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.331860:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184197760:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.331888:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.331915:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184198272:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.331942:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.331962:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184198784:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.331986:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.332009:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788581355.332016:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184197376:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.332039:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.332066:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184197888:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.332104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581355.332125:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184198400:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.332150:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.332234:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197248 00000100:00100000:3.0:1788581355.332242:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197248 00000100:00100000:3.0:1788581355.332314:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788581355.332322:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184197248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581355.332370:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184197248:12345-0@lo:400:kworker.0 Request processed in 48us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.332376:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788581355.332406:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197376 00000100:00100000:3.0:1788581355.332410:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197376 00000100:00100000:3.0:1788581355.332432:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197888 00000100:00100000:3.0:1788581355.332435:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197888 00000100:00100000:2.0:1788581355.332674:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198400 00000100:00100000:2.0:1788581355.332680:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198400 00000100:00100000:2.0:1788581355.332706:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788581355.332714:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184197376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.332756:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184197376:12345-0@lo:400:kworker.0 Request processed in 43us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.332763:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788581355.332776:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788581355.332781:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.332807:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184197888:12345-0@lo:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.332812:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788581355.332822:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788581355.332827:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184198400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.332850:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184198400:12345-0@lo:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.332856:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788581355.332877:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198144 00000100:00100000:2.0:1788581355.332880:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198144 00000100:00100000:2.0:1788581355.332913:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198656 00000100:00100000:2.0:1788581355.332916:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198656 00000100:00100000:2.0:1788581355.332928:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198272 00000100:00100000:2.0:1788581355.332930:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198272 00000100:00100000:2.0:1788581355.332940:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198784 00000100:00100000:2.0:1788581355.332943:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198784 00000100:00100000:2.0:1788581355.332955:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788581355.332961:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333003:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184198144:12345-0@lo:400:kworker.0 Request processed in 42us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333008:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788581355.333020:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788581355.333026:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184198656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333068:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184198656:12345-0@lo:400:kworker.0 Request processed in 42us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333073:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788581355.333084:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581355.333089:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1875463184198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333112:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1875463184198272:12345-0@lo:400:kworker.0 Request processed in 23us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333117:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788581355.333127:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788581355.333132:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184198784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333156:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184198784:12345-0@lo:400:kworker.0 Request processed in 24us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333161:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788581355.333185:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581355.333196:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581355.333199:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581355.333201:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581355.333217:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184197760 00000100:00100000:2.0:1788581355.333221:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184197760 00000100:00100000:2.0:1788581355.333249:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581355.333276:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184197760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333311:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184197760:12345-0@lo:400:kworker.0 Request processed in 38us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333317:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581355.333398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184198912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581355.333432:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581355.333465:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184198912 00000100:00100000:2.0:1788581355.333468:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184198912 00000100:00100000:2.0:1788581355.333493:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788581355.333499:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184198912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581355.333526:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788581355.333563:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184198912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.333569:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788581355.333621:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184198912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581355.333656:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184198144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333667:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184198656:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333737:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184197376:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333747:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184197888:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184198400:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333778:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184197248:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333789:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184197760:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333799:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184198272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581355.333807:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184198784:0@lo:400:kworker.0 00000100:00100000:0.0:1788581355.336322:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581355.336350:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184199040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581355.336431:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581355.340176:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184199040 00000100:00100000:3.0:1788581355.340196:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184199040 00000100:00100000:3.0:1788581355.340293:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788581355.340305:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184199040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581355.340334:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788581355.340422:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184199040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581355.340428:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788581355.340477:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184199040:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788581355.492166:0:14625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581355.492180:0:14625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581355.492224:0:14625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788581355.492231:0:14625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581355.641652:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.641765:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515456 00000100:00100000:2.0:1788581355.641779:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515456 00000100:00100000:2.0:1788581355.641848:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1788581355.641861:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:12361:x1875463170515456:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581355.641884:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581355.641928:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b308bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2229c expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.642063:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b308c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.642078:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b308c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.642090:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b308c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581355.642103:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788581355.642224:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b308bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2229c expref: 26 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.642399:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b308c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2229c expref: 25 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.642409:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:2.0:1788581355.642413:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581355.642416:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:2.0:1788581355.642561:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12361:x1875463170515456:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 701us (920us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788581355.642569:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:1.0:1788581355.658735:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581355.663390:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515584 00000100:00100000:0.0:1788581355.663410:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515584 00000100:00100000:1.0:1788581355.674079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:1.0:1788581355.674095:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12361:x1875463170515584:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:1.0:1788581355.674174:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.674193:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.674203:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.674217:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.674223:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.674229:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676035:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676064:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676089:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581355.676144:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676158:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676164:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676171:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676176:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581355.676180:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676187:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676199:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:1.0:1788581355.676202:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581355.676206:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676212:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5400/0x50f0cc74b7b308d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676225:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676238:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676244:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676249:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581355.676338:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676345:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676353:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e51befe00) 00010000:00010000:1.0:1788581355.676356:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581355.676358:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676363:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b308d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676377:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676383:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676388:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676392:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581355.676401:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676406:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676413:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e51bef200) 00010000:00010000:1.0:1788581355.676414:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581355.676417:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.676421:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5800/0x50f0cc74b7b308de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581355.677128:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12361:x1875463170515584:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 3028us (18393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.677141:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:1.0:1788581355.741879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581355.742008:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515840 00000100:00100000:3.0:1788581355.742027:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515840 00000100:00100000:3.0:1788581355.742098:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:3.0:1788581355.742109:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12364:x1875463170515840:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581355.742135:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581355.742158:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b308e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222a3 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742241:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742289:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742303:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742319:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742326:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742332:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742441:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742450:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742457:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581355.742475:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788581355.742551:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742558:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742564:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742570:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581355.742574:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742580:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742592:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581355.742595:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581355.742599:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742605:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b308ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742616:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742621:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742635:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742640:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581355.742643:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742649:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742656:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934300) 00010000:00010000:3.0:1788581355.742658:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581355.742660:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742665:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b308f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742702:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b308e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 28 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742714:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 27 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581355.742721:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:3.0:1788581355.742723:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581355.742725:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981000, rc 0) 00000100:00100000:3.0:1788581355.742786:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12364:x1875463170515840:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 680us (918us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788581355.742802:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:0.0:1788581355.751659:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.753328:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170515968 00000100:00100000:1.0:1788581355.753346:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170515968 00000100:00100000:1.0:1788581355.753426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 205 00000100:00100000:1.0:1788581355.753438:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12364:x1875463170515968:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:1.0:1788581355.753526:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753544:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753557:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753621:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753629:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753636:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753643:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581355.753647:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753655:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753669:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:1.0:1788581355.753673:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581355.753679:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.753685:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30908 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581355.753779:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12364:x1875463170515968:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 342us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.753787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 205 00000100:00100000:1.0:1788581355.757454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.757607:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170516224 00000100:00100000:2.0:1788581355.757618:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170516224 00000100:00100000:2.0:1788581355.757693:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1788581355.757704:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12364:x1875463170516224:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581355.757968:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:12364:x1875463170516224:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 265us (526us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788581355.757977:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1788581355.832447:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581355.832502:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170516480 00000100:00100000:0.0:1788581355.832515:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170516480 00000100:00100000:0.0:1788581355.832584:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:0.0:1788581355.832597:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:11896:x1875463170516480:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581355.832627:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581355.832655:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3090f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222aa expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.832790:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.832817:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 29 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.832826:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.832862:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 29 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.832876:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 29 pid: 11562 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581355.832905:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184199168:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581355.833029:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581355.844544:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.844622:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184199168:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581355.844677:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581355.848590:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170516608 00000100:00100000:1.0:1788581355.848610:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170516608 00010000:00010000:1.0:1788581355.848671:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 30 pid: 11562 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581355.848725:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:1.0:1788581355.848737:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:2396:x1875463170516608:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581355.848755:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581355.848762:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 30 pid: 11562 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848777:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 30 pid: 11562 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848802:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b308fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222a3 expref: 30 pid: 11562 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848822:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:1.0:1788581355.848827:0:7444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848836:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848843:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.848888:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581355.848959:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:2396:x1875463170516608:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 224us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.848967:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00010000:00010000:1.0:1788581355.849161:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.849171:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581355.849194:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788581355.849380:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3090f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.849397:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.849405:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:1.0:1788581355.849408:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581355.849411:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70600, rc 0) 00000100:00100000:1.0:1788581355.849448:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:11896:x1875463170516480:12345-192.168.203.3@tcp:101:bash.0 Request processed in 16854us (17011us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788581355.849456:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:0.0:1788581355.866516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.866812:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170516736 00000100:00100000:2.0:1788581355.866823:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170516736 00000100:00100000:2.0:1788581355.866899:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 207 00000100:00100000:2.0:1788581355.866912:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:11896:x1875463170516736:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581355.866940:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581355.866966:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30924 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222b1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867021:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3092b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867067:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867083:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867216:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b1 expref: 31 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867245:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3092b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b1 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.867274:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:2.0:1788581355.867278:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581355.867282:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272c00, rc 0) 00000100:00100000:2.0:1788581355.867346:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11896:x1875463170516736:12345-192.168.203.3@tcp:101:bash.0 Request processed in 437us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.867353:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 207 00000100:00100000:1.0:1788581355.871302:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581355.871436:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170516992 00000100:00100000:0.0:1788581355.871447:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170516992 00000100:00100000:0.0:1788581355.871520:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 208 00000100:00100000:0.0:1788581355.871532:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:11896:x1875463170516992:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1788581355.871786:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.871804:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.871815:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581355.871875:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788581355.872332:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000126af22a reply state 000000006cde602f transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.872348:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581355.872357:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581355.872360:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581355.872365:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788581355.872457:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788581355.872579:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:11896:x1875463170516992:12345-192.168.203.3@tcp:36:bash.0 Request processed in 1047us (1689us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788581355.872587:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 208 00000020:00080000:0.0:1788581355.872592:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788581355.884879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.884971:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517120 00000100:00100000:2.0:1788581355.884983:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517120 00000100:00100000:2.0:1788581355.885075:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:2.0:1788581355.885089:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+34:11896:x1875463170517120:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581355.885125:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581355.885152:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30939 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222b8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.885227:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b8 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.885316:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b8 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581355.885389:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:1.0:1788581355.885392:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581355.885403:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:1.0:1788581355.885493:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:11896:x1875463170517120:12345-192.168.203.3@tcp:101:bash.0 Request processed in 407us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581355.885501:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:3.0:1788581355.889437:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581355.889617:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517248 00000100:00100000:2.0:1788581355.889632:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517248 00000100:00100000:2.0:1788581355.889707:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1788581355.889718:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:11896:x1875463170517248:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581355.889739:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581355.889762:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222bf expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581355.889794:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b95e9, atime: 0x6a9b95e8, ctime: 0x6a9b95e9, blocks: 0x8 00010000:00010000:2.0:1788581355.889822:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788581355.889826:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581355.889835:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.889858:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581355.889872:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273200, rc 0) 00000100:00100000:2.0:1788581355.889944:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:11896:x1875463170517248:12345-192.168.203.3@tcp:101:bash.0 Request processed in 228us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581355.889952:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1788581355.903228:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581355.903499:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517376 00000100:00100000:1.0:1788581355.903512:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517376 00002000:00010000:0.0:1788581355.903658:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788581355.903669:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995e7fb34000 with x1875463170517376 ext(0->18446744073709551615) 00002000:00010000:0.0:1788581355.903688:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995e7fb34000. 00000100:00100000:0.0:1788581355.903728:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1788581355.903740:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2395:x1875463170517376:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:0.0:1788581355.904221:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788581355.904225:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788581353 -> 1788581355 00002000:00010000:0.0:1788581355.904228:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788581352 -> 1788581352 00002000:00010000:0.0:1788581355.904230:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788581353 -> 1788581355 00002000:00010000:0.0:1788581355.904232:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788581355.904361:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170517376:12345-192.168.203.3@tcp:10:bash.0 Request processed in 622us (1143us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788581355.904383:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00002000:00010000:0.0:1788581355.904387:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788581355.904390:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995e7fb34000 with x1875463170517376 ext(0->18446744073709551615) 00002000:00010000:0.0:1788581355.904396:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995e7fb34000. 00000100:00100000:0.0:1788581356.042384:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581356.042551:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517504 00000100:00100000:3.0:1788581356.042564:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517504 00000100:00100000:3.0:1788581356.042637:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:3.0:1788581356.042648:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:12378:x1875463170517504:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1788581356.042728:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042748:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042761:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042777:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042785:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042791:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042864:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042873:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042879:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581356.042945:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042958:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042965:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042973:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042980:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581356.042985:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.042993:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043007:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581356.043010:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581356.043016:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043022:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043051:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043057:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043070:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043075:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581356.043078:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043085:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043095:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f934300) 00010000:00010000:3.0:1788581356.043097:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581356.043100:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043106:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b3094e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043122:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043128:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043134:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043139:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581356.043142:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043159:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043168:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:3.0:1788581356.043170:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581356.043173:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.043179:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581356.043337:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:12378:x1875463170517504:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 690us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581356.043346:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:3.0:1788581356.110102:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.110914:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517760 00000100:00100000:0.0:1788581356.110932:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517760 00000100:00100000:0.0:1788581356.111029:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:0.0:1788581356.111052:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+35:12381:x1875463170517760:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581356.111076:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.111109:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3095c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222c6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111408:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111424:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111436:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111452:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111459:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111466:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111606:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30971 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111615:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111622:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.111631:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788581356.111709:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111716:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111723:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111728:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.111733:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111741:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.111754:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.111757:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.111762:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113934:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113961:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113968:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113975:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113981:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.113985:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.113993:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.114011:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581356.114014:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.114018:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.115133:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b3096a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.115269:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3095c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222c6 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.115288:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30971 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222c6 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.115321:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581356.115324:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581356.115327:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70a00, rc 0) 00000100:00100000:0.0:1788581356.115437:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12381:x1875463170517760:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 4385us (5356us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788581356.115447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:2.0:1788581356.121675:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.121858:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170517888 00000100:00100000:0.0:1788581356.121870:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170517888 00000100:00100000:0.0:1788581356.121942:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:0.0:1788581356.121954:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12381:x1875463170517888:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581356.123473:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.123506:0:9504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 37 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.123517:0:9504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.123573:0:9504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 37 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.123590:0:9504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 37 pid: 6493 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.123605:0:9504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184199296:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581356.124304:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581356.128237:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.128713:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9504:1875463184199296:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581356.128752:0:9504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581356.128847:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170518144 00000100:00100000:3.0:1788581356.128857:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170518144 00000100:00100000:3.0:1788581356.128980:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1788581356.128995:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:10755:x1875463170518144:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788581356.129514:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:10755:x1875463170518144:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 519us (1292us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788581356.129524:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1788581356.138564:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.139295:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170518272 00000100:00100000:2.0:1788581356.139311:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170518272 00010000:00010000:2.0:1788581356.139532:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 39 pid: 6493 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.143296:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:2.0:1788581356.143337:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:2395:x1875463170518272:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581356.143382:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581356.143400:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 39 pid: 6493 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143423:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 39 pid: 6493 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143458:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30916 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222aa expref: 39 pid: 6493 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143485:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:2.0:1788581356.143492:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143504:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143514:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.143568:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581356.143705:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:2395:x1875463170518272:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 389us (5157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.143716:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00010000:00010000:0.0:1788581356.143849:0:9504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143860:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143917:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143925:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143931:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143938:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.143944:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143952:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143963:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581356.143966:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581356.143970:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.143989:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b3097f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.144061:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12381:x1875463170517888:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 22108us (22397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581356.144072:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:0.0:1788581356.151185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.151315:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170518528 00000100:00100000:2.0:1788581356.151332:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170518528 00000100:00100000:2.0:1788581356.151427:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1788581356.151441:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+37:12381:x1875463170518528:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581356.151815:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:12381:x1875463170518528:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 374us (645us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788581356.151825:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00010000:00010000:2.0:1788581356.230564:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581356.270743:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.270942:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170518784 00000100:00100000:0.0:1788581356.270959:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170518784 00000100:00100000:0.0:1788581356.271063:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:0.0:1788581356.271078:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+38:12392:x1875463170518784:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1788581356.271115:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.271146:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222cd expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271298:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271316:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271331:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271348:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271355:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271386:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271557:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b3099b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271569:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b3099b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271576:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b3099b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.271589:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788581356.271710:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271718:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271726:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271732:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.271738:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271746:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271762:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.271765:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.271777:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271783:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b3098d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271801:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271808:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271814:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271819:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.271822:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271827:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271834:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581356.271836:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.271838:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271843:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b30994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271895:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222cd expref: 41 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271921:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b3099b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222cd expref: 40 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.271928:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581356.271931:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581356.271933:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581356.272044:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12392:x1875463170518784:12345-192.168.203.3@tcp:101:cat.0 Request processed in 960us (1313us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788581356.272053:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:1.0:1788581356.283073:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.284684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519040 00000100:00100000:2.0:1788581356.284711:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519040 00000100:00100000:2.0:1788581356.284830:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1788581356.284844:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+40:12392:x1875463170519040:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1788581356.285440:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:12392:x1875463170519040:12345-192.168.203.3@tcp:35:cat.0 Request processed in 594us (2380us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788581356.285451:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1788581356.330355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.330681:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519296 00000100:00100000:0.0:1788581356.330697:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519296 00000100:00100000:0.0:1788581356.330782:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:0.0:1788581356.330794:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+41:12393:x1875463170519296:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1788581356.330872:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788581356.330912:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30939 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b8 expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.330940:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b3099b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222cd expref: 40 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.330953:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30971 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222c6 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.330965:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b3092b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222b1 expref: 38 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331001:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581356.331008:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581356.331056:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331071:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331082:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331098:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331106:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331113:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331230:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331239:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.331246:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581356.333613:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788581356.333683:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342475427005ns, next at 343475383908ns, rc = 0 00010000:00010000:0.0:1788581356.333808:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333828:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333843:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333853:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333860:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333866:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333899:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581356.333934:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333942:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333949:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333956:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.333962:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333972:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.333997:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581356.334000:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788581356.334008:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334015:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334061:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334069:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334074:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334080:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.334083:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334089:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334098:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.334100:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.334104:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334109:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581356.334132:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d089c78 reply state 00000000ef752439 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334145:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.334152:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581356.334165:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581356.334170:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581356.334355:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:12393:x1875463170519296:12345-192.168.203.3@tcp:36:rm.0 Request processed in 3556us (4021us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788581356.334367:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 214 00010000:00010000:2.0:1788581356.334828:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581356.334838:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.334846:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581356.334850:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.334858:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.334882:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:2.0:1788581356.334885:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788581356.334889:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.334895:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b309be lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.334909:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581356.334911:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581356.334913:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581356.353924:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581356.353967:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184199424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581356.355285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581356.362876:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184199424 00000100:00100000:0.0:1788581356.362906:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184199424 00000100:00100000:0.0:1788581356.363070:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788581356.363087:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184199424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581356.363151:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581356.363351:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184199424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 268us (8102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581356.363361:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788581356.364978:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184199424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581356.418954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.419094:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519552 00000100:00100000:0.0:1788581356.419110:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519552 00000100:00100000:0.0:1788581356.419303:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:0.0:1788581356.419318:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+39:12399:x1875463170519552:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581356.419357:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.420414:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222d4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420597:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420615:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420631:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420644:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420652:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.420660:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581356.421152:0:9504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788581356.421420:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421431:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421442:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421488:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421517:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421526:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421534:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.421540:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421549:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421568:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.421571:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.421578:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421585:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581356.421603:0:9504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050665e89 reply state 00000000786128bb transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421616:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421622:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581356.421625:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581356.421629:0:9504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788581356.421671:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 42 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421697:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 41 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.421706:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581356.421709:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581356.421711:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581356.421821:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:12399:x1875463170519552:12345-192.168.203.3@tcp:101:bash.0 Request processed in 2505us (2880us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788581356.421831:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:1.0:1788581356.425485:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.425750:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519680 00000100:00100000:2.0:1788581356.425766:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519680 00000100:00100000:2.0:1788581356.425850:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1788581356.425865:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170519680:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581356.425897:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581356.425929:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222db expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581356.425965:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581356.425996:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788581356.426003:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581356.426017:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.426088:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.426110:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272c00, rc 0) 00000100:00100000:2.0:1788581356.427483:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2393:x1875463170519680:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1610us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.427497:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1788581356.429956:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.430523:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519808 00000100:00100000:2.0:1788581356.430540:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519808 00000100:00100000:2.0:1788581356.430625:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:2.0:1788581356.430637:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:12399:x1875463170519808:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581356.430662:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581356.430687:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222e2 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.430733:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.430744:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581356.430750:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581356.430756:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.430802:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.430840:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.430858:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1875463184199552:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581356.430987:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581356.436064:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1875463184199552:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581356.436125:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.436234:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272200, rc 0) 00000100:00100000:2.0:1788581356.436619:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:12399:x1875463170519808:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5982us (6677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.436630:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:3.0:1788581356.439792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.440445:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170519936 00000100:00100000:0.0:1788581356.440477:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170519936 00010000:00010000:0.0:1788581356.440550:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.440615:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:0.0:1788581356.440628:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45353450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170519936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581356.440649:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581356.440687:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.440705:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.440737:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a20d791/0x50f0cc74b7b309e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222db expref: 9 pid: 8409 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.440777:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581356.440783:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581356.440794:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.440816:0:7444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.440873:0:7444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.440891:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7444:1875463184199680:192.168.203.3@tcp:105: 00000100:00100000:0.0:1788581356.441016:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581356.449732:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.449866:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170520192 00000100:00100000:2.0:1788581356.449882:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170520192 00000100:00100000:2.0:1788581356.449959:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1788581356.449973:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+42:12399:x1875463170520192:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1788581356.450468:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12399:x1875463170520192:12345-192.168.203.3@tcp:35:bash.0 Request processed in 495us (751us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788581356.450478:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1788581356.451740:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7444:1875463184199680:192.168.203.3@tcp:105: 00010000:00010000:0.0:1788581356.451780:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581356.451850:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45353450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170519936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 11223us (12071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581356.451862:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:3.0:1788581356.684391:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.684812:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170520320 00000100:00100000:0.0:1788581356.684828:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170520320 00000100:00100000:0.0:1788581356.684918:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:0.0:1788581356.684931:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+43:12415:x1875463170520320:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581356.684966:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.684994:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222e9 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685122:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685142:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685174:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.685234:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788581356.685239:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581356.685326:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685360:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b309f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e9 expref: 45 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685397:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e9 expref: 44 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.685407:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.685410:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581356.685415:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581356.685748:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:12415:x1875463170520320:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 818us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581356.685757:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:3.0:1788581356.700964:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.701123:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170520576 00000100:00100000:0.0:1788581356.701138:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170520576 00000100:00100000:0.0:1788581356.701243:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:0.0:1788581356.701295:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+44:12415:x1875463170520576:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581356.701327:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.701356:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222f0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.701529:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.701548:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.701563:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.701578:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788581356.701728:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f0 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.701752:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f0 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.701762:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581356.701766:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581356.701771:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71e00, rc 0) 00000100:00100000:0.0:1788581356.701858:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+46:12415:x1875463170520576:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 604us (913us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788581356.701867:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:1.0:1788581356.710571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581356.710646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.710665:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170520832 00000100:00100000:0.0:1788581356.710698:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170520832 00000100:00100000:0.0:1788581356.710792:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:0.0:1788581356.710806:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+46:12415:x1875463170520832:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581356.710843:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.710872:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222f7 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.711028:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.711056:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.711069:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.711083:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788581356.711224:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f7 expref: 49 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.711246:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f7 expref: 48 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.711336:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581356.711339:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788581356.711344:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70e00, rc 0) 00000100:00100000:0.0:1788581356.711419:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:12415:x1875463170520832:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 616us (862us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788581356.711428:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:3.0:1788581356.711558:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170520960 00000100:00100000:3.0:1788581356.711565:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170520960 00000100:00100000:3.0:1788581356.711615:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581356.711623:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+48:2393:x1875463170520960:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581356.711634:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581356.711651:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f0 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.711663:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:3.0:1788581356.711667:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581356.711688:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:2393:x1875463170520960:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581356.711695:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581356.719286:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.719709:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521088 00000100:00100000:0.0:1788581356.719723:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521088 00000100:00100000:0.0:1788581356.719802:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1788581356.719814:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170521088:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1788581356.719873:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.719898:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.719908:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581356.719913:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581356.719918:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.719958:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.719984:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 8 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.720001:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184199808:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581356.720132:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581356.723394:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.723694:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875463184199808:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581356.723730:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581356.723861:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521216 00000100:00100000:1.0:1788581356.723870:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521216 00002000:00100000:1.0:1788581356.723932:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff995d4396b100 x1875463170521216/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:712/0 lens 504/0 e 0 to 0 dl 1788581367 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581356.723943:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4396b100 with x1875463170521216 ext(0->8) 00010000:00010000:1.0:1788581356.723951:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 9 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.723966:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 9 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581356.723974:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d4396b100 00000100:00100000:1.0:1788581356.724019:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1788581356.724041:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170521216:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:1.0:1788581356.725488:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2396:x1875463170521216:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 1446us (2097us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788581356.725523:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:1.0:1788581356.725536:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff995d4396b100 x1875463170521216/t4294967309(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:712/0 lens 504/448 e 0 to 0 dl 1788581367 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581356.725546:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d4396b100 with x1875463170521216 ext(0->8) 00010000:00010000:1.0:1788581356.725556:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.725574:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581356.725582:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff995d4396b100 00000100:00100000:1.0:1788581356.728761:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.728883:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521344 00000100:00100000:2.0:1788581356.728897:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521344 00010000:00010000:2.0:1788581356.728958:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.729057:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:2.0:1788581356.729071:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2396:x1875463170521344:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581356.729093:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788581356.729123:0:6480:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788581356.729126:0:6480:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788581356 00002000:00010000:2.0:1788581356.729129:0:6480:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788581356 00002000:00010000:2.0:1788581356.729131:0:6480:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788581356 00002000:00010000:2.0:1788581356.729133:0:6480:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788581356.729142:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.729160:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.729190:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c64e6ba/0x50f0cc74b7b309ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df222e2 expref: 11 pid: 8410 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.729214:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581356.729219:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581356.729227:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.729239:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.729372:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581356.729446:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2396:x1875463170521344:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 377us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.729639:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00010000:00010000:1.0:1788581356.730778:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730799:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730834:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730845:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730854:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730881:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581356.730887:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730899:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730922:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581356.730931:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528954fd/0x50f0cc74b7b30a2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581356.731048:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170521088:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 11223us (11792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581356.731057:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1788581356.734417:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.734537:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521600 00000100:00100000:2.0:1788581356.734551:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521600 00000100:00100000:2.0:1788581356.734624:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1788581356.734637:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+47:12415:x1875463170521600:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1788581356.734729:0:6497:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f7 expref: 47 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581356.734990:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788581356.735027:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788581356.735524:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788581356.735573:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.735592:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 51 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.735603:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.735652:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 51 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.735673:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 51 pid: 9504 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.735715:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184199936:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581356.735846:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581356.743217:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6497:1875463184199936:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581356.743293:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581356.744757:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581356.745128:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521728 00000100:00100000:3.0:1788581356.745142:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521728 00010000:00010000:3.0:1788581356.745193:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 52 pid: 9504 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581356.745244:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:3.0:1788581356.745293:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+52:2395:x1875463170521728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581356.745311:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581356.745319:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 52 pid: 9504 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745353:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 52 pid: 9504 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745382:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b309da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df222d4 expref: 52 pid: 9504 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745405:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:3.0:1788581356.745412:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745422:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745431:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581356.745472:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581356.745544:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+51:2395:x1875463170521728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 289us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581356.745552:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00010000:00010000:2.0:1788581356.745792:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.745802:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581356.745944:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788581356.746087:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788581356.746188:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184200064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788581356.746287:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581356.746323:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581356.746896:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184200064 00000100:00100000:3.0:1788581356.746906:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184200064 00000100:00100000:3.0:1788581356.746984:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788581356.746994:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6497:x1875463184200064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788581356.747108:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6497:x1875463184200064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581356.747116:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1788581356.747337:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581356.747375:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184200064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788581356.747672:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788581356.747740:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184200192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788581356.747778:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581356.747808:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581356.747865:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184200192 00000100:00100000:0.0:1788581356.747872:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184200192 00000100:00100000:0.0:1788581356.747909:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788581356.747917:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6497:x1875463184200192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788581356.748055:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6497:x1875463184200192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (276us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788581356.748063:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788581356.748672:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6497:1875463184200192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788581356.748747:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788581356.748815:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748828:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748838:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748845:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581356.748851:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748859:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748880:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581356.748884:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788581356.748890:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.748897:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581356.749049:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788581356.749130:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788581356.749144:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342890889038ns, next at 343890886419ns, rc = 0 00000001:00080000:2.0:1788581356.749151:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788581356.749177:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581356.749180:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788581356.749189:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222f7 expref: 55 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.749821:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:12415:x1875463170521600:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 15182us (15413us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788581356.749833:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000020:00080000:2.0:1788581356.749840:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788581356.756743:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.756830:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170521856 00000100:00100000:2.0:1788581356.756844:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170521856 00000100:00100000:2.0:1788581356.756920:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:2.0:1788581356.756931:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+54:12415:x1875463170521856:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581356.756963:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581356.756992:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b30a3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df222fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.757074:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b30a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222fe expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.757090:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b30a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222fe expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.757111:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581356.757114:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581356.757118:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272800, rc 0) 00000100:00100000:2.0:1788581356.757189:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:12415:x1875463170521856:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 259us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.757196:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:0.0:1788581356.760827:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581356.761240:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170522112 00000100:00100000:3.0:1788581356.761298:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170522112 00000100:00100000:3.0:1788581356.761378:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1788581356.761390:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+55:12415:x1875463170522112:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581356.761757:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:12415:x1875463170522112:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 367us (947us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788581356.761766:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581356.841121:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581356.841205:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170522240 00000100:00100000:2.0:1788581356.841221:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170522240 00000100:00100000:2.0:1788581356.841379:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:2.0:1788581356.841394:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:12425:x1875463170522240:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1788581356.841526:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841551:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841577:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841591:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841599:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841606:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841713:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841721:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841729:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581356.841801:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841817:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841832:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841841:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841848:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581356.841866:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841876:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841893:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:2.0:1788581356.841896:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581356.841903:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841910:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841928:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841934:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841940:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841946:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581356.841955:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841962:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841971:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:2.0:1788581356.841974:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581356.841978:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841984:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.841995:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842001:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842007:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842012:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581356.842015:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842021:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842028:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581356.842042:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581356.842052:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581356.842058:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581356.842899:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:12425:x1875463170522240:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 1500us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581356.842912:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:1.0:1788581356.885431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.886574:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170522496 00000100:00100000:0.0:1788581356.886595:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170522496 00000100:00100000:0.0:1788581356.886682:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1788581356.886695:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+56:12428:x1875463170522496:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581356.886724:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581356.886752:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22305 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886862:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886882:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886898:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886913:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886946:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.886954:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887107:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887116:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887124:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581356.887135:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788581356.887225:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887233:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887241:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887247:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.887556:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887575:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887604:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581356.887607:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.887613:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887620:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30a5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887634:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887640:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887646:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887652:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.887656:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887661:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887667:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581356.887670:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581356.887672:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887678:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887732:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22305 expref: 59 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887747:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22305 expref: 58 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.887755:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581356.887757:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581356.887760:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581356.887931:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12428:x1875463170522496:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1237us (2514us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788581356.887940:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:2.0:1788581356.895421:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581356.895957:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170522624 00000100:00100000:0.0:1788581356.895973:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170522624 00000100:00100000:0.0:1788581356.896183:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:0.0:1788581356.896198:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12428:x1875463170522624:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581356.896339:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896364:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896386:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896441:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896473:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896480:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896487:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581356.896493:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896503:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896743:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581356.896748:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581356.896756:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581356.896762:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581356.896948:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12428:x1875463170522624:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 751us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581356.896957:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:1.0:1788581356.903683:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581356.903822:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170522880 00000100:00100000:3.0:1788581356.903839:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170522880 00000100:00100000:3.0:1788581356.904053:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1788581356.904067:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+58:12428:x1875463170522880:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581356.904422:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12428:x1875463170522880:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 357us (757us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788581356.904431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1788581357.006203:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.006589:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170523136 00000100:00100000:2.0:1788581357.006605:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170523136 00000100:00100000:2.0:1788581357.006770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:2.0:1788581357.006784:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+59:12438:x1875463170523136:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581357.006817:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581357.006821:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788581357.006925:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b309fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222e9 expref: 59 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.006950:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:2.0:1788581357.006956:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581357.006976:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2230c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.007127:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.007142:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.007170:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581357.007185:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788581357.007492:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30a82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2230c expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.007509:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2230c expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.007518:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581357.007521:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581357.007523:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581357.007609:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:12438:x1875463170523136:12345-192.168.203.3@tcp:101:bash.0 Request processed in 828us (1421us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788581357.007618:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00080000:0.0:1788581357.009675:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581357.011398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.011458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.011630:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170523264 00000100:00100000:2.0:1788581357.011644:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170523264 00000100:00100000:2.0:1788581357.011724:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:2.0:1788581357.011736:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:12438:x1875463170523264:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581357.011767:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581357.011794:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22313 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.011841:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.011892:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.011907:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.012071:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30a97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 62 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.012095:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.012106:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581357.012109:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581357.012113:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272c00, rc 0) 00000100:00100000:2.0:1788581357.012198:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:12438:x1875463170523264:12345-192.168.203.3@tcp:101:bash.0 Request processed in 464us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581357.012205:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:1.0:1788581357.012879:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170523392 00000100:00100000:1.0:1788581357.012890:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170523392 00000100:00100000:1.0:1788581357.012965:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581357.012974:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+61:2393:x1875463170523392:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581357.012988:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581357.013011:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2230c expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.013027:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:1.0:1788581357.013042:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581357.013086:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:2393:x1875463170523392:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 113us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581357.013094:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1788581357.017766:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581357.020716:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170523648 00000100:00100000:1.0:1788581357.020739:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170523648 00000100:00100000:1.0:1788581357.020961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 225 00000100:00100000:1.0:1788581357.020977:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+60:12438:x1875463170523648:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1788581357.021062:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581357.021096:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22305 expref: 60 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.021121:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:1.0:1788581357.021127:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581357.021402:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.021421:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.021433:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581357.021527:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788581357.021555:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000130411b3 reply state 0000000073f708ca transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.021570:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.021577:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:1.0:1788581357.021580:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581357.021583:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581357.021721:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12438:x1875463170523648:12345-192.168.203.3@tcp:36:bash.0 Request processed in 747us (3966us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788581357.021729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 225 00000020:00080000:1.0:1788581357.021734:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788581357.024973:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.025590:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170523776 00000100:00100000:2.0:1788581357.025606:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170523776 00000100:00100000:2.0:1788581357.025730:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00100000:2.0:1788581357.025744:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+62:12438:x1875463170523776:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581357.025780:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581357.025811:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2231a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.025960:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.025999:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.026014:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581357.026061:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788581357.026067:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581357.026090:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.026122:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 64 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.026142:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.026151:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581357.026154:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581357.026158:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272400, rc 0) 00000100:00100000:2.0:1788581357.026245:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:12438:x1875463170523776:12345-192.168.203.3@tcp:101:bash.0 Request processed in 505us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581357.026300:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00100000:3.0:1788581357.030020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.030157:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524032 00000100:00100000:0.0:1788581357.030171:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524032 00000100:00100000:0.0:1788581357.030315:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581357.030329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+63:12438:x1875463170524032:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:0.0:1788581357.030687:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+64:12438:x1875463170524032:12345-192.168.203.3@tcp:35:bash.0 Request processed in 360us (682us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788581357.030699:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581357.097170:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.097648:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524160 00000100:00100000:2.0:1788581357.097664:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524160 00000100:00100000:2.0:1788581357.097752:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:2.0:1788581357.097765:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+64:12444:x1875463170524160:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581357.097802:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581357.097849:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22321 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.097947:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.097965:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.097980:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581357.098081:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788581357.098086:0:9504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581357.098115:0:9504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.098149:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22321 expref: 66 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.098174:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22321 expref: 65 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.098186:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:2.0:1788581357.098190:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581357.098194:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:2.0:1788581357.098348:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170524160:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 584us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581357.098357:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:3.0:1788581357.104399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.104765:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524288 00000100:00100000:0.0:1788581357.104779:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524288 00000100:00100000:0.0:1788581357.104861:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:0.0:1788581357.104873:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170524288:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581357.104904:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581357.104948:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30ac8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22328 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105081:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105099:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105112:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105125:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105132:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105139:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105251:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105298:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105307:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581357.105360:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788581357.105366:0:11562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581357.105389:0:11562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105404:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105412:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105419:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105426:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105431:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581357.105435:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105443:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105480:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581357.105483:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581357.105489:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105495:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30acf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.105511:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106077:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106086:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106092:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581357.106095:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106102:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106112:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581357.106114:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581357.106117:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106123:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30ad6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106178:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30ac8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22328 expref: 67 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106194:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22328 expref: 66 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.106201:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581357.106203:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581357.106205:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581357.106651:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12444:x1875463170524288:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1776us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.106662:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:3.0:1788581357.113165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.113219:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.113251:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524672 00000100:00100000:3.0:1788581357.113283:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524672 00000100:00100000:3.0:1788581357.113372:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581357.113385:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:2395:x1875463170524672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581357.113404:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581357.113441:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30add lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22328 expref: 66 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.113510:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581357.113520:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581357.114117:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524544 00000100:00100000:2.0:1788581357.114136:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524544 00000100:00100000:2.0:1788581357.114191:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:2.0:1788581357.114201:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12444:x1875463170524544:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581357.114222:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581357.114243:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2232f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.114409:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.114425:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.114435:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.114499:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.114516:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581357.114533:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184200320:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581357.115411:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:2395:x1875463170524672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2020us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581357.115425:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1788581357.115747:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581357.119361:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.119512:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184200320:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581357.119550:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581357.119788:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170524800 00000100:00100000:1.0:1788581357.119797:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170524800 00010000:00010000:1.0:1788581357.119860:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581357.119908:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:1.0:1788581357.119919:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:2396:x1875463170524800:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581357.119937:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581357.119945:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.119958:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.120014:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b30ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2231a expref: 67 pid: 6493 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.120044:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:1.0:1788581357.120050:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.120062:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.120071:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581357.120095:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581357.120214:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.120230:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581357.120272:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788581357.120481:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b30ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.120498:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 67 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581357.120507:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581357.120510:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581357.120512:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e000, rc 0) 00000100:00100000:1.0:1788581357.121069:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:2396:x1875463170524800:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1146us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581357.121081:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:2.0:1788581357.121144:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12444:x1875463170524544:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 6943us (7992us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788581357.121152:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:3.0:1788581357.125055:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.125203:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525056 00000100:00100000:0.0:1788581357.125216:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525056 00000100:00100000:0.0:1788581357.125326:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1788581357.125339:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12444:x1875463170525056:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:0.0:1788581357.125358:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581357.125390:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272800/0x50f0cc74b7b30a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222fe expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.125415:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581357.125421:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581357.125659:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170525056:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 322us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.125667:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1788581357.129091:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.129209:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525184 00000100:00100000:3.0:1788581357.129222:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525184 00000100:00100000:3.0:1788581357.129703:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:3.0:1788581357.129718:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170525184:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:3.0:1788581357.129991:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.130237:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.130392:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581357.130651:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788581357.130823:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170525184:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 1105us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581357.130834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:1.0:1788581357.133921:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.134023:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525312 00000100:00100000:0.0:1788581357.134045:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525312 00000100:00100000:0.0:1788581357.134159:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1788581357.134172:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+65:12444:x1875463170525312:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581357.134202:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581357.134227:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22336 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134698:0:11562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134713:0:11562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 66 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134736:0:11562:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134751:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 66 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134768:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581357.134771:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581357.134775:0:11562:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 66 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.134783:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71c00, rc 0) 00000100:00100000:0.0:1788581357.134992:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12444:x1875463170525312:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 821us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.135000:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00010000:00010000:0.0:1788581357.249559:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581357.889668:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581357.889684:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581357.889744:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788581357.889762:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581357.889968:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184200448:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581357.890709:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290300 going to sleep for 11 seconds 00000001:00080000:0.0:1788581357.892865:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788581357.892882:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788581357.918579:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184200448:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581357.918678:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.918936:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525440 00000100:00100000:0.0:1788581357.918948:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525440 00000100:00100000:0.0:1788581357.919035:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:0.0:1788581357.919049:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12446:x1875463170525440:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788581357.919092:0:6495:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788581357.919243:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12446:x1875463170525440:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 196us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.919674:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:1.0:1788581357.924295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.924423:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525568 00000100:00100000:3.0:1788581357.924437:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525568 00000100:00100000:3.0:1788581357.924622:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:3.0:1788581357.924635:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12446:x1875463170525568:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788581357.924739:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.924766:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.924784:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926425:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926452:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926466:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926507:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926519:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926545:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581357.926612:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788581357.926618:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581357.926632:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926643:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926648:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926654:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926657:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581357.926661:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926666:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926676:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:3.0:1788581357.926678:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581357.926682:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926686:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926706:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926710:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926713:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926716:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581357.926717:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926721:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926725:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff995e6f934300) 00010000:00010000:3.0:1788581357.926726:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581357.926727:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926730:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926741:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926744:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926747:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926754:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581357.926756:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926759:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926763:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581357.926764:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581357.926766:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.926769:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581357.927065:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12446:x1875463170525568:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 2427us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581357.927076:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:1.0:1788581357.933635:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.934321:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525824 00000100:00100000:0.0:1788581357.934338:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525824 00000100:00100000:0.0:1788581357.934436:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:0.0:1788581357.934450:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+66:12446:x1875463170525824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581357.934484:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581357.934516:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2233d expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934721:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934743:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934761:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581357.934777:0:11562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788581357.934914:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934924:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934931:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934937:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581357.934942:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934953:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934970:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581357.934973:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581357.934981:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.934986:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.935051:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b1c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2233d expref: 68 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.935063:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:0.0:1788581357.935065:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581357.935069:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2233d expref: 68 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.935091:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581357.935173:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170525824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 726us (1559us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788581357.935181:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:0.0:1788581357.945232:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581357.946115:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170525952 00000100:00100000:2.0:1788581357.946135:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170525952 00000100:00100000:2.0:1788581357.946215:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:2.0:1788581357.946227:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170525952:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788581357.946297:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788581357.946436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170525952:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 211us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581357.946444:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:1.0:1788581357.955398:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.955566:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170526208 00000100:00100000:3.0:1788581357.955576:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170526208 00000100:00100000:3.0:1788581357.955633:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:3.0:1788581357.955644:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170526208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581357.955665:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581357.955668:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581357.955696:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b30ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22321 expref: 67 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.955716:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581357.955737:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581357.955753:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22344 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581357.956148:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788581357.956437:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.956451:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.956461:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.956515:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22344 expref: 69 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.956530:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22344 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.956538:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995e6f934300) 00010000:00010000:3.0:1788581357.956541:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581357.956543:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981200, rc 0) 00000100:00100000:3.0:1788581357.956642:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:12446:x1875463170526208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 999us (1253us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788581357.956649:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:1.0:1788581357.973984:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.974203:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170526464 00000100:00100000:0.0:1788581357.974220:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170526464 00000100:00100000:0.0:1788581357.974728:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:0.0:1788581357.974747:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:12446:x1875463170526464:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581357.974990:0:11562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581357.975037:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b30b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22344 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.975063:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995e6f934300) 00010000:00010000:0.0:1788581357.975076:0:11562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581357.975104:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.975122:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.975133:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979087:0:11562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979131:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979145:0:11562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979198:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979206:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979214:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979219:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581357.979224:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979232:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979244:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:0.0:1788581357.979247:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581357.979271:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979278:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30b46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979291:0:11562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979303:0:11562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979308:0:11562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979313:0:11562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581357.979316:0:11562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979322:0:11562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979329:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7feec95c (ffff995d4233dc00) 00010000:00010000:0.0:1788581357.979332:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581357.979335:0:11562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.979341:0:11562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b30b4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7feec95c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581357.982374:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170526464:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 7619us (8390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581357.982397:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:2.0:1788581357.986066:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.986609:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170526592 00000100:00100000:0.0:1788581357.986621:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170526592 00000100:00100000:0.0:1788581357.986702:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:0.0:1788581357.986716:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eba5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+67:12446:x1875463170526592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581357.986749:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581357.986788:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2234b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.986832:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.986847:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.986861:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.986980:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 69 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.986999:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 68 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.987009:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581357.987012:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581357.987016:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581357.987078:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eba5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:12446:x1875463170526592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 365us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.987086:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:1.0:1788581357.991135:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.992070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170526848 00000100:00100000:3.0:1788581357.992082:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170526848 00000100:00100000:3.0:1788581357.992154:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:3.0:1788581357.992167:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+68:12446:x1875463170526848:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581357.992329:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.992351:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.992367:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581357.992557:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788581357.992567:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344134312586ns, next at 345134309671ns, rc = 0 00000004:00010000:3.0:1788581357.992623:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1e9e010 reply state 00000000391dff8b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.992637:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581357.992647:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:3.0:1788581357.992650:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788581357.992655:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581357.992787:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+70:12446:x1875463170526848:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 622us (1664us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788581357.992794:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:1.0:1788581357.995230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581357.995358:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170526976 00000100:00100000:0.0:1788581357.995367:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170526976 00000100:00100000:0.0:1788581357.995479:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:0.0:1788581357.995490:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+70:12446:x1875463170526976:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581357.995512:0:11562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581357.995542:0:11562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22352 expref: -99 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.995598:0:11562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 71 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.995613:0:11562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 71 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581357.995632:0:11562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581357.995636:0:11562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581357.995640:0:11562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71e00, rc 0) 00000100:00100000:0.0:1788581357.995969:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+71:12446:x1875463170526976:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 479us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581357.995977:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:2.0:1788581357.999101:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581357.999628:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170527104 00000100:00100000:3.0:1788581357.999641:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170527104 00000100:00100000:2.0:1788581357.999923:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1788581357.999935:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2396:x1875463170527104:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788581358.000181:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2396:x1875463170527104:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 248us (1090us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788581358.000189:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00080000:0.0:1788581358.000797:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581358.003107:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581358.003304:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170527360 00000100:00100000:0.0:1788581358.003316:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170527360 00000100:00100000:3.0:1788581358.003423:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1788581358.003438:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+71:12446:x1875463170527360:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581358.003802:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+72:12446:x1875463170527360:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 366us (704us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788581358.003828:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1788581358.006447:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.006697:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170527616 00000100:00100000:2.0:1788581358.006708:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170527616 00000100:00100000:2.0:1788581358.006812:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1788581358.006826:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+72:12446:x1875463170527616:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581358.006973:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+72:12446:x1875463170527616:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 150us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.006981:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1788581358.009356:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.009892:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170527744 00000100:00100000:3.0:1788581358.009903:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170527744 00000100:00100000:3.0:1788581358.009964:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:3.0:1788581358.009975:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+72:12446:x1875463170527744:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581358.009997:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581358.010020:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22359 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.010105:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.010123:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.010137:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581358.010731:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581358.010758:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.010795:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b30b70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22359 expref: 74 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.010816:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22359 expref: 73 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.010824:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581358.010828:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788581358.010851:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:2.0:1788581358.010998:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+73:12446:x1875463170527744:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1023us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.011007:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:1.0:1788581358.020369:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.020760:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170527872 00000100:00100000:2.0:1788581358.020770:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170527872 00000100:00100000:2.0:1788581358.020861:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1788581358.020873:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+10:2394:x1875463170527872:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581358.020894:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581358.020927:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22360 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581358.020957:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b95ee, blocks: 0x0 00010000:00010000:2.0:1788581358.020982:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788581358.020987:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581358.020998:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.021019:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.021044:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:2.0:1788581358.021154:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2394:x1875463170527872:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 283us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.021162:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:1.0:1788581358.029616:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581358.029798:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528128 00000100:00100000:0.0:1788581358.029807:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528128 00000100:00100000:0.0:1788581358.029873:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:0.0:1788581358.029884:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+73:12446:x1875463170528128:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581358.029985:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+73:12446:x1875463170528128:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581358.030001:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:0.0:1788581358.039048:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.039862:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528256 00000100:00100000:2.0:1788581358.039887:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528256 00000100:00100000:2.0:1788581358.040088:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581358.040103:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:12446:x1875463170528256:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581358.040126:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581358.040149:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22367 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.040187:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.040198:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581358.040870:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581358.040879:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.040998:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.041016:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.041041:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875463184200576:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581358.041310:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581358.059040:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875463184200576:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581358.059087:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.059134:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ea00, rc 0) 00000100:00100000:2.0:1788581358.059203:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:12446:x1875463170528256:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 19104us (20164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.059213:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1788581358.061204:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.061330:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528384 00000100:00100000:2.0:1788581358.061341:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528384 00010000:00010000:2.0:1788581358.061399:0:7444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.061459:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:2.0:1788581358.061469:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:2396:x1875463170528384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581358.061483:0:7444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581358.061504:0:7444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.061519:0:7444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.061542:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b30b7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22360 expref: 12 pid: 8409 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.061560:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581358.061740:0:7444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581358.061752:0:7444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.061776:0:7444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.066543:0:7444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.066585:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7444:1875463184200704:192.168.203.3@tcp:105: 00000100:00100000:2.0:1788581358.066701:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581358.078495:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7444:1875463184200704:192.168.203.3@tcp:105: 00010000:00010000:2.0:1788581358.078525:0:7444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581358.078617:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2396:x1875463170528384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 17148us (17424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.078628:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:3.0:1788581358.080344:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581358.081044:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528512 00000100:00100000:0.0:1788581358.081055:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528512 00002000:00100000:0.0:1788581358.081121:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff995d43be1880 x1875463170528512/t0(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:714/0 lens 504/0 e 0 to 0 dl 1788581369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581358.081132:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43be1880 with x1875463170528512 ext(0->12) 00002000:00010000:0.0:1788581358.081138:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43be1880 00000100:00100000:0.0:1788581358.081173:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1788581358.081183:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+11:2396:x1875463170528512:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788581358.082181:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:2396:x1875463170528512:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 994us (1838us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788581358.082192:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00002000:00100000:0.0:1788581358.082200:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff995d43be1880 x1875463170528512/t4294967321(0) o4->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:714/0 lens 504/448 e 0 to 0 dl 1788581369 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581358.082209:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43be1880 with x1875463170528512 ext(0->12) 00002000:00010000:0.0:1788581358.082212:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43be1880 00000100:00100000:1.0:1788581358.105118:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.105215:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528640 00000100:00100000:2.0:1788581358.105226:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528640 00000100:00100000:2.0:1788581358.105300:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:2.0:1788581358.105311:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+73:12446:x1875463170528640:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788581358.109439:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788581358.109465:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:0.0:1788581358.109477:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109489:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109497:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581358.109501:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788581358.109503:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109507:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109515:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788581358.109525:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e47c6a3c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788581358.109529:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e6fbbbb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e47c6a900 00000020:00080000:1.0:1788581358.109532:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e4eb95100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995d42e83000 00010000:00010000:0.0:1788581358.109544:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff995e6f934d00) 00010000:00010000:0.0:1788581358.109547:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581358.109552:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109558:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b3088a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581358.109559:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788581358.109584:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e525cecc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788581358.109587:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e42e22900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e525ceb40 00000020:00080000:1.0:1788581358.109589:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e42e22e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995d43abd200 00010000:00010000:0.0:1788581358.109607:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109614:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109620:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109625:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109628:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109634:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109642:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff995e6f934600) 00010000:00010000:0.0:1788581358.109645:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581358.109648:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109653:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70800/0x50f0cc74b7b30932 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109679:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109686:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109692:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109698:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109701:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109706:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109714:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581358.109716:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581358.109719:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109725:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70000/0x50f0cc74b7b309b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109736:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109742:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109747:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109757:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109760:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109767:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109775:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995d4233da00) 00010000:00010000:0.0:1788581358.109778:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581358.109780:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109786:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b309d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109812:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109819:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109824:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109829:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109832:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109838:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109855:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581358.109857:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581358.109860:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109866:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d4800/0x50f0cc74b7b30aa5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109879:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109886:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109892:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109897:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581358.109900:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109906:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109913:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:0.0:1788581358.109914:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581358.109917:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.109923:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b30b62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788581358.110108:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788581358.110167:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788581358.110357:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12446:x1875463170528640:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 5039us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.110380:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:3.0:1788581358.110631:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581358.110647:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184201088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788581358.110722:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581358.110800:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184201088 00000100:00100000:3.0:1788581358.110807:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184201088 00000100:00100000:3.0:1788581358.110861:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581358.110871:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184201088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788581358.110898:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788581358.110931:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b95ec, atime: 0x6a9b95ec, ctime: 0x6a9b95ec, blocks: 0x8 00010000:00010000:3.0:1788581358.110946:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.110960:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1788581358.110964:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581358.110970:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.110986:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.110996:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111002:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111020:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581358.111172:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184201088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 302us (449us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788581358.111179:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788581358.111197:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581358.111207:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581358.111213:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111221:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581358.111231:0:10311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111240:0:10311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111285:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111293:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30b8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.111313:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581358.111315:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581358.111316:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581358.111345:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788581358.111353:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:3.0:1788581358.111389:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d423e7800, transno 4294967308 00000004:00080000:3.0:1788581358.111398:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:3.0:1788581358.111413:0:3621:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff995d43be2680 x1875463184201088/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788581374 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788581358.111424:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995d43be2680/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788581358.111429:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184201088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788581358.112036:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184200832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788581358.112081:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581358.112127:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581358.112133:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184200960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788581358.112157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581358.112187:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184200832 00000100:00100000:0.0:1788581358.112193:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184200832 00000100:00100000:0.0:1788581358.112235:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184200960 00000100:00100000:0.0:1788581358.112238:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184200960 00000100:00100000:0.0:1788581358.112275:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788581358.112284:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1875463184200832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788581358.112306:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788581358.112326:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.112341:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.112349:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788581358.112353:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581358.112357:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.112398:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581358.112430:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 12 pid: 8410 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581358.112443:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875463184201216:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581358.112494:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1600 going to sleep for 11 seconds 00000100:00080000:0.0:1788581358.112504:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581358.112516:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788581358.112523:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3618:x1875463184200960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788581358.113065:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788581358.113071:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788581358 00002000:00010000:0.0:1788581358.113073:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788581358.113075:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788581358 -> 1788581358 00002000:00010000:0.0:1788581358.113078:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788581358.113129:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3618:x1875463184200960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 605us (970us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788581358.113137:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1788581358.113320:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e7fb36680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788581358.113328:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184200960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788581358.127965:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581358.128061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581358.128174:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875463184201216:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581358.128202:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.128283:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528896 00000100:00100000:2.0:1788581358.128290:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528896 00010000:00010000:2.0:1788581358.128328:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 13 pid: 8410 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.128381:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:2.0:1788581358.128392:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+13:2395:x1875463170528896:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581358.128408:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581358.128414:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 13 pid: 8410 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.128428:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 13 pid: 8410 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.128453:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b30940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0x3786f996df222bf expref: 13 pid: 8410 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.128468:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581358.128472:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581358.128477:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.128488:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.128518:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581358.128586:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:2395:x1875463170528896:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 195us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.128593:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00010000:00010000:1.0:1788581358.128874:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.128885:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.128895:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.128903:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.128938:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788581358.129104:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3618:x1875463184200832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16820us (17021us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788581358.129112:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581358.129129:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170528768 00000100:00100000:1.0:1788581358.129132:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170528768 00000100:00100000:1.0:1788581358.129156:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1788581358.129163:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+12:2394:x1875463170528768:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788581358.129808:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581358.129816:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.129827:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581358.129831:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.129839:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.129861:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.129869:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b30b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.129890:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581358.129892:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581358.129894:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788581358.129932:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e7fb36300/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788581358.129939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184200832:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788581358.139821:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788581358.139837:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788581358.142716:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2394:x1875463170528768:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 13540us (14748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581358.142729:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1788581358.149912:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.150035:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529152 00000100:00100000:2.0:1788581358.150046:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529152 00000100:00100000:2.0:1788581358.150119:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:2.0:1788581358.150131:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12446:x1875463170529152:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581358.150189:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581358.150223:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b30b77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22359 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.150244:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581358.150250:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581358.150848:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.150864:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.150875:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581358.150999:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f0d6a7 reply state 00000000ef9496c4 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.151012:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.151018:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581358.151033:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581358.151037:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581358.151576:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12446:x1875463170529152:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1444us (1671us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788581358.151602:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:0.0:1788581358.160205:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.160428:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529280 00000100:00100000:3.0:1788581358.160439:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529280 00000100:00100000:3.0:1788581358.160508:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:3.0:1788581358.160519:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170529280:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788581358.160690:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788581358.160694:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788581358 -> 1788581357 00002000:00010000:3.0:1788581358.160696:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788581356 00002000:00010000:3.0:1788581358.160699:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788581358 -> 1788581357 00002000:00010000:3.0:1788581358.160701:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788581358.160783:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170529280:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 265us (587us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788581358.160791:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:0.0:1788581358.178868:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581358.178982:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529536 00000100:00100000:1.0:1788581358.178995:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529536 00000100:00100000:1.0:1788581358.179083:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:1.0:1788581358.179092:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:12446:x1875463170529536:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788581358.179164:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.179183:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 22 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.179193:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.179230:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 22 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.179295:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 22 pid: 9504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581358.179309:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184201344:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581358.179401:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d63a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581358.182803:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.183011:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529664 00000100:00100000:3.0:1788581358.183032:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529664 00010000:00010000:3.0:1788581358.183074:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 23 pid: 9504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.183129:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:3.0:1788581358.183140:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2396:x1875463170529664:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581358.183158:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581358.183166:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 23 pid: 9504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.183180:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 23 pid: 9504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.183207:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:3.0:1788581358.183213:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.183224:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.183245:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.183307:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581358.183369:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+23:2396:x1875463170529664:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 231us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.183376:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00010000:00010000:2.0:1788581358.184324:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b30b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2234b expref: 22 pid: 9504 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.184343:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184201344:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581358.184363:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184372:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184378:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184415:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184421:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184428:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184433:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581358.184448:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184602:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184634:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581358.184636:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788581358.184641:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.184647:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f9d5c00/0x50f0cc74b7b30ba1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.184726:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12446:x1875463170529536:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 5633us (5867us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788581358.184735:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:1.0:1788581358.188197:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.188362:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529792 00000100:00100000:3.0:1788581358.188372:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529792 00000100:00100000:3.0:1788581358.188428:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1788581358.188437:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2393:x1875463170529792:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788581358.188496:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.188517:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.188525:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581358.188529:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581358.188533:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.188566:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.188580:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 8 pid: 8408 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.188607:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184201472:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581358.188698:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581358.192591:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.192659:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170529920 00000100:00100000:2.0:1788581358.192668:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170529920 00010000:00010000:2.0:1788581358.192702:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 9 pid: 8408 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.192746:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:2.0:1788581358.192755:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170529920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581358.192769:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581358.192793:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 9 pid: 8408 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.192808:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 9 pid: 8408 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.192834:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581358.192839:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581358.192857:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.192868:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.192890:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581358.192946:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+9:2395:x1875463170529920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 191us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.192954:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00010000:00010000:3.0:1788581358.193721:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b30b85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22367 expref: 8 pid: 8408 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.193739:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1875463184201472:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581358.193760:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193770:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193777:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193797:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193804:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193811:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193833:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581358.193838:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193847:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193861:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.193869:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b10c3f/0x50f0cc74b7b30ba8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.193936:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170529792:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 5499us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.193944:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:0.0:1788581358.202953:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.203078:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170530176 00000100:00100000:2.0:1788581358.203090:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170530176 00000100:00100000:2.0:1788581358.203161:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:2.0:1788581358.203174:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:12446:x1875463170530176:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581358.203319:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.203337:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.203347:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.203384:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.203398:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 21 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.203424:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184201600:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581358.203528:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581358.206596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.206718:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170530304 00000100:00100000:3.0:1788581358.206727:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170530304 00010000:00010000:3.0:1788581358.206763:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 22 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.206803:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:3.0:1788581358.206813:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2396:x1875463170530304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581358.206827:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581358.206834:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 22 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206859:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 22 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206880:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581358.206886:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 22 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206896:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206903:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206910:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.206927:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581358.206987:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2396:x1875463170530304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.206994:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00010000:00010000:2.0:1788581358.207917:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272c00/0x50f0cc74b7b30a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22313 expref: 21 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.207942:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184201600:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581358.207967:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.207977:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.207983:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.208521:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.208535:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 21 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.208544:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.208575:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 21 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.208590:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 21 pid: 11562 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.208618:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184201728:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581358.208702:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581358.212724:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184201728:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581358.212761:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581358.217576:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.217754:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170530432 00000100:00100000:2.0:1788581358.217765:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170530432 00010000:00010000:2.0:1788581358.217805:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 22 pid: 11562 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.217844:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:2.0:1788581358.217854:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2396:x1875463170530432:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581358.217870:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581358.217878:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 22 pid: 11562 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217892:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 22 pid: 11562 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217914:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b30b69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22352 expref: 22 pid: 11562 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217929:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:2.0:1788581358.217935:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217957:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217965:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.217994:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581358.218055:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:2396:x1875463170530432:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 201us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.218062:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00010000:00010000:3.0:1788581358.218186:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.218196:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581358.218337:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788581358.218621:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788581358.218663:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788581358.218760:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1875463184201856:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788581358.218812:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581358.218845:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54d166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581358.218929:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184201856 00000100:00100000:2.0:1788581358.218934:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184201856 00000100:00100000:2.0:1788581358.218968:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788581358.218976:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6495:x1875463184201856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788581358.219071:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6495:x1875463184201856:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.219079:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788581358.220015:0:6495:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788581358.220036:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1788581358.220058:0:6495:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e7fb36680, transno 4294967322 00000004:00080000:3.0:1788581358.220069:0:6495:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e7fb36300, transno 4294967323 00000100:00100000:3.0:1788581358.220076:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1875463184201856:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788581358.220239:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788581358.220708:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1875463184201984:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788581358.220779:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581358.220819:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581358.221044:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184201984 00000100:00100000:0.0:1788581358.221051:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184201984 00000100:00100000:0.0:1788581358.221106:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788581358.221115:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6495:x1875463184201984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788581358.221298:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6495:x1875463184201984:12345-0@lo:1000:mdt00_002.0 Request processed in 183us (518us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788581358.221306:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788581358.221603:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1875463184201984:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788581358.221643:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221654:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221663:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221669:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581358.221675:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221684:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221702:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:3.0:1788581358.221718:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581358.221724:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221731:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bb6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221760:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221767:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221773:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221779:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581358.221783:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221789:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221798:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581358.221800:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581358.221807:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 24 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221818:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 24 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221827:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 24 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.221861:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 24 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.221873:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184202112:192.168.203.3@tcp:105: 00000100:00100000:3.0:1788581358.221948:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581358.226749:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.226844:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170530560 00000100:00100000:2.0:1788581358.226855:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170530560 00000100:00100000:2.0:1788581358.226927:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1788581358.226939:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12444:x1875463170530560:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:2.0:1788581358.227094:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+25:12444:x1875463170530560:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 155us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.227168:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1788581358.227329:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1875463184202112:192.168.203.3@tcp:105: 00010000:00010000:3.0:1788581358.227359:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227373:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b30af9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227406:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227423:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227435:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227599:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227605:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227613:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227645:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581358.227651:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227660:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227674:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581358.227678:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581358.227681:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227687:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30bbd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227697:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227704:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227710:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227715:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581358.227718:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227724:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227744:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581358.227746:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581358.227749:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.227756:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30baf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.227904:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12446:x1875463170530176:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 24731us (24961us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788581358.227913:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 247 00000020:00080000:3.0:1788581358.227917:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788581358.228841:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581358.228847:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581358.231561:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788581358.231609:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581358.233947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581358.234045:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.234585:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170530816 00000100:00100000:2.0:1788581358.234598:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170530816 00000100:00100000:2.0:1788581358.234701:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1788581358.234712:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+24:12446:x1875463170530816:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788581358.234969:0:6497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788581358.234997:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788581358.235039:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235055:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235068:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235077:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235084:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235090:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.235116:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581358.235199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12446:x1875463170530816:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 488us (1264us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788581358.235206:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:2.0:1788581358.235210:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788581358.235414:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531072 00000100:00100000:3.0:1788581358.235420:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531072 00000100:00100000:3.0:1788581358.235475:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:3.0:1788581358.235484:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12444:x1875463170531072:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:3.0:1788581358.235601:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788581358.235644:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12444:x1875463170531072:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 161us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.235651:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00010000:00010000:1.0:1788581358.236002:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581358.236012:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.236031:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581358.236035:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.236044:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.236060:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:1.0:1788581358.236064:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581358.236068:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.236075:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bc4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581358.236116:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581358.236119:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581358.236120:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581358.274218:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581358.286147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581358.286712:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531200 00000100:00100000:2.0:1788581358.286744:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531200 00000100:00100000:2.0:1788581358.286816:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:2.0:1788581358.286828:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+26:12448:x1875463170531200:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581358.286854:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581358.286877:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2236e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.286948:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.286963:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.286975:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.286991:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.286998:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287005:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287121:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287132:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287141:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287187:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.287201:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 27 pid: 6495 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581358.287216:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184202240:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581358.288040:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e54e18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581358.299936:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1875463184202240:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581358.299971:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581358.317011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581358.317144:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531456 00000100:00100000:0.0:1788581358.317159:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531456 00000100:00100000:0.0:1788581358.317237:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1788581358.317249:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:6161:x1875463170531456:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788581358.317618:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:6161:x1875463170531456:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 371us (619us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788581358.317627:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:1.0:1788581358.326787:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581358.328456:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531584 00000100:00100000:3.0:1788581358.328468:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531584 00010000:00010000:3.0:1788581358.328520:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 29 pid: 6495 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581358.328565:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:3.0:1788581358.328739:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:2395:x1875463170531584:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581358.328769:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581358.328777:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 29 pid: 6495 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328792:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 29 pid: 6495 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328826:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b30aeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2232f expref: 29 pid: 6495 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328846:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581358.328852:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328862:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328870:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581358.328902:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581358.328962:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:2395:x1875463170531584:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 228us (2186us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581358.329015:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329034:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581358.329085:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788581358.329089:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581358.329117:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329131:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329149:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329167:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329175:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329180:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581358.329185:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329193:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329203:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:2.0:1788581358.329206:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581358.329209:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329216:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b30bd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329228:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329234:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329240:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329245:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581358.329294:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329301:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329310:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff995e6f92a300) 00010000:00010000:2.0:1788581358.329312:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581358.329316:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329322:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ea00/0x50f0cc74b7b30bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329359:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f000/0x50f0cc74b7b30bcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2236e expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329372:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2236e expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581358.329380:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581358.329382:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581358.329385:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44000, rc 0) 00000100:00100000:2.0:1788581358.329409:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+28:12448:x1875463170531200:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 42584us (43276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.329417:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:3.0:1788581358.342415:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:2.0:1788581358.401734:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581358.401767:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184202368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581358.401856:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581358.402243:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184202368 00000100:00100000:3.0:1788581358.402274:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184202368 00000100:00100000:3.0:1788581358.402350:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788581358.402361:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184202368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581358.402394:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788581358.402464:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184202368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.402471:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788581358.402694:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184202368:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788581358.403249:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581358.403428:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581358.403446:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581358.403518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581358.403764:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184202496 00000100:00100000:2.0:1788581358.403772:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184202496 00000100:00100000:2.0:1788581358.403818:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788581358.403828:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184202496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581358.403848:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788581358.403906:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184202496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581358.403913:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788581358.405127:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581358.918961:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581358.918996:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184202624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581358.919073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581358.919288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184202624 00000100:00100000:3.0:1788581358.919298:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184202624 00000100:00100000:3.0:1788581358.919343:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788581358.919354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184202624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581358.919388:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788581358.919438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184202624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581358.919445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788581358.919528:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184202624:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788581359.047153:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788581359.234119:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581359.234129:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581359.234158:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788581359.234168:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581359.234355:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184202752:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581359.234594:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581359.240594:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13766:1875463184202752:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581359.246452:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581359.246543:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531712 00000100:00100000:3.0:1788581359.246553:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531712 00000100:00100000:3.0:1788581359.246740:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:3.0:1788581359.246751:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12459:x1875463170531712:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581359.246785:0:6495:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581359.246899:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12459:x1875463170531712:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 150us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581359.246906:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00080000:0.0:1788581359.247873:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581359.261164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581359.261249:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170531968 00000100:00100000:0.0:1788581359.261292:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170531968 00000100:00100000:0.0:1788581359.261349:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:0.0:1788581359.261361:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+27:12459:x1875463170531968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581359.261382:0:9504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581359.261419:0:9504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30be7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22375 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.261533:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30bee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.261546:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.261559:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581359.261570:0:9504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788581359.261848:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b30be7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22375 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.261869:0:9504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22375 expref: 29 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.261879:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581359.261882:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581359.261887:0:9504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70600, rc 0) 00000100:00100000:0.0:1788581359.261961:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:12459:x1875463170531968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 602us (806us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788581359.261968:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:0.0:1788581359.284470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581359.284678:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170532224 00000100:00100000:2.0:1788581359.284692:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170532224 00000100:00100000:2.0:1788581359.284769:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:2.0:1788581359.284781:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:12459:x1875463170532224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581359.284870:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.284890:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.284901:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285115:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285123:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285130:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285137:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581359.285142:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285150:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285163:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581359.285167:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581359.285171:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.285177:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30bfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581359.285314:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:12459:x1875463170532224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 534us (853us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788581359.285322:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000040:00080000:2.0:1788581359.285523:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581359.285528:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581359.285986:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788581359.286006:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581359.287516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581359.287590:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170532352 00000100:00100000:2.0:1788581359.287600:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170532352 00000100:00100000:2.0:1788581359.289338:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1788581359.289360:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:2395:x1875463170532352:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581359.289380:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581359.289408:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70600/0x50f0cc74b7b30bee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22375 expref: 30 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.289428:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581359.289434:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581359.289500:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:2395:x1875463170532352:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 149us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581359.289508:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1788581359.290474:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581359.290559:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170532608 00000100:00100000:3.0:1788581359.290567:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170532608 00000100:00100000:3.0:1788581359.290607:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:3.0:1788581359.290616:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+29:12459:x1875463170532608:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581359.290837:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:12459:x1875463170532608:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 222us (367us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788581359.290844:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00010000:00010000:3.0:1788581359.299428:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581359.451780:0:14676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581359.451790:0:14676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581359.451822:0:14676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788581359.451833:0:14676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581359.761381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581359.761948:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170532864 00000100:00100000:2.0:1788581359.761958:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170532864 00000100:00100000:2.0:1788581359.762051:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:2.0:1788581359.762064:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+30:12472:x1875463170532864:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581359.762086:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581359.762104:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30c03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2237c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.762210:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44c00/0x50f0cc74b7b30c0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.762224:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44c00/0x50f0cc74b7b30c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.762235:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44c00/0x50f0cc74b7b30c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581359.762276:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788581359.762377:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44e00/0x50f0cc74b7b30c03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2237c expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.762393:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44c00/0x50f0cc74b7b30c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2237c expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581359.762402:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581359.762404:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788581359.762408:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44c00, rc 0) 00000100:00100000:2.0:1788581359.762521:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:12472:x1875463170532864:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 460us (1147us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788581359.762529:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:2.0:1788581359.766088:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581359.767119:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170532992 00000100:00100000:0.0:1788581359.767131:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170532992 00000100:00100000:0.0:1788581359.767218:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:0.0:1788581359.767229:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:12472:x1875463170532992:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581359.767323:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767340:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767353:0:9504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767386:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767394:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767402:0:9504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767408:0:9504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581359.767412:0:9504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767420:0:9504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767451:0:9504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:0.0:1788581359.767467:0:9504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581359.767471:0:9504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581359.767479:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b30c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581359.767552:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:12472:x1875463170532992:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 325us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581359.767560:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:3.0:1788581359.874021:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581359.878125:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533120 00000100:00100000:2.0:1788581359.878140:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533120 00000100:00080000:0.0:1788581359.878228:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581359.878234:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:2.0:1788581359.878248:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170533120:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1788581359.878295:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581359.878389:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30c1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22383 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581359.878418:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b95ed, atime: 0x6a9b95ec, ctime: 0x6a9b95ed, blocks: 0x8 00010000:00010000:3.0:1788581359.878438:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788581359.878442:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581359.878453:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30c1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22383 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581359.878473:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30c1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22383 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581359.878488:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980600, rc 0) 00000100:00100000:3.0:1788581359.878554:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2393:x1875463170533120:12345-192.168.203.3@tcp:101:cat.0 Request processed in 310us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581359.878560:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1788581359.883482:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581359.883635:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533248 00000100:00100000:1.0:1788581359.883646:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533248 00002000:00100000:1.0:1788581359.883703:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff995d43be1180 x1875463170533248/t0(0) o3->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:715/0 lens 488/0 e 0 to 0 dl 1788581370 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581359.883714:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43be1180 with x1875463170533248 ext(0->4095) 00002000:00010000:1.0:1788581359.883720:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43be1180 00000100:00100000:1.0:1788581359.883760:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581359.883770:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2394:x1875463170533248:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:1.0:1788581359.883945:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2394:x1875463170533248:12345-192.168.203.3@tcp:3:cat.0 Request processed in 176us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788581359.883953:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00002000:00100000:1.0:1788581359.883960:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff995d43be1180 x1875463170533248/t0(0) o3->36c1c238-f3ab-41d9-b90e-c3af2be29807@192.168.203.3@tcp:715/0 lens 488/4536 e 0 to 0 dl 1788581370 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581359.883987:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d43be1180 with x1875463170533248 ext(0->4095) 00002000:00010000:1.0:1788581359.883990:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d43be1180 00010000:00010000:1.0:1788581360.322821:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581360.360317:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.360578:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533376 00000100:00100000:0.0:1788581360.360588:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533376 00000100:00100000:0.0:1788581360.360646:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 386 00000100:00100000:0.0:1788581360.360657:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170533376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581360.360749:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170533376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 93us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581360.360757:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 386 00000100:00100000:0.0:1788581360.363086:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.363129:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.363161:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.363191:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.363209:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581360.363229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581360.363312:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533504 00000100:00100000:2.0:1788581360.363322:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533504 00000100:00100000:2.0:1788581360.363373:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534016 00000100:00100000:2.0:1788581360.363376:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534016 00000100:00100000:2.0:1788581360.363403:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533632 00000100:00100000:2.0:1788581360.363406:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533632 00000100:00100000:2.0:1788581360.363418:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534144 00000100:00100000:2.0:1788581360.363421:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534144 00000100:00100000:2.0:1788581360.363453:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:2.0:1788581360.363462:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:2395:x1875463170533504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581360.363529:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+32:2395:x1875463170533504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.363537:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:2.0:1788581360.363558:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:2.0:1788581360.363564:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581360.363589:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.363594:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:2.0:1788581360.363605:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:2.0:1788581360.363611:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170533632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581360.363639:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170533632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.363644:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:2.0:1788581360.363654:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:2.0:1788581360.363660:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534144:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581360.363679:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534144:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.363684:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00080000:2.0:1788581360.363706:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581360.363710:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581360.364070:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533760 00000100:00100000:1.0:1788581360.364075:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533760 00000100:00100000:1.0:1788581360.364120:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170533888 00000100:00100000:1.0:1788581360.364124:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170533888 00000100:00100000:1.0:1788581360.364144:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:1.0:1788581360.364150:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170533760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581360.364180:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170533760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581360.364186:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:1.0:1788581360.364197:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1788581360.364204:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170533888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581360.364227:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+8:2396:x1875463170533888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581360.364233:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00080000:2.0:1788581360.364851:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581360.449857:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184202880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581360.449928:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581360.450563:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184203008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.450605:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581360.459859:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203008 00000100:00100000:3.0:1788581360.459875:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203008 00000100:00100000:3.0:1788581360.459949:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788581360.459973:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184203008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.460074:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3621:x1875463184203008:12345-0@lo:400:kworker.0 Request processed in 103us (9467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581360.460084:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788581360.460130:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184202880 00000100:00100000:3.0:1788581360.460135:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184202880 00000100:00100000:3.0:1788581360.460171:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788581360.460177:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184202880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581360.460199:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581360.460233:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184202880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (10305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581360.460238:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788581360.460287:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184203136:0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.460323:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581360.460372:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581360.460389:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203136 00000100:00100000:3.0:1788581360.460392:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203136 00000100:00100000:3.0:1788581360.460421:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788581360.460426:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184203136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.461164:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184203136:12345-0@lo:400:kworker.0 Request processed in 734us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581360.461173:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788581360.466862:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184203264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.466939:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581360.467554:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184203008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.467564:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184203520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.467596:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581360.467668:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203264 00000100:00100000:0.0:1788581360.467675:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203264 00000100:00100000:0.0:1788581360.467724:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203520 00000100:00100000:0.0:1788581360.467727:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203520 00000100:00100000:0.0:1788581360.467742:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788581360.467750:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184203264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.467809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184203264:12345-0@lo:400:kworker.0 Request processed in 58us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581360.467816:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788581360.467834:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581360.467840:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184203520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.467868:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184203520:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581360.467874:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581360.474857:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184202880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581360.474874:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184203392:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.480749:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.480792:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184203776:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.480858:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581360.480904:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581360.480923:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184204288:0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.480936:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184203904:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.480951:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581360.481022:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203776 00000100:00100000:2.0:1788581360.481028:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203776 00000100:00100000:0.0:1788581360.481047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581360.481074:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184204416:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.481083:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203392 00000100:00100000:2.0:1788581360.481087:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203392 00000100:00100000:0.0:1788581360.481100:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581360.481111:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204288 00000100:00100000:2.0:1788581360.481115:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204288 00000100:00100000:2.0:1788581360.481141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788581360.481152:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184203776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.481154:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203904 00000100:00100000:0.0:1788581360.481159:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203904 00000100:00100000:0.0:1788581360.481191:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204416 00000100:00100000:0.0:1788581360.481194:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204416 00000100:00100000:2.0:1788581360.481219:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184203776:12345-0@lo:400:kworker.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581360.481219:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788581360.481228:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184203904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.481231:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788581360.481284:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788581360.481293:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184203904:12345-0@lo:400:kworker.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.481295:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184203392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.481307:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788581360.481324:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788581360.481332:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184204416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.481342:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184203392:12345-0@lo:400:kworker.0 Request processed in 49us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.481349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788581360.481368:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184204416:12345-0@lo:400:kworker.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.481370:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788581360.481379:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788581360.481385:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.481421:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184203392:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.481426:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184204288:12345-0@lo:400:kworker.0 Request processed in 44us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.481435:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788581360.481437:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184203904:0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.481446:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184204416:0@lo:400:kworker.0 00000100:00080000:0.0:1788581360.481481:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581360.481485:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581360.481656:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184203136:0@lo:400:kworker.0 00010000:00080000:2.0:1788581360.483694:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb36300 x1875463184203776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581360.483728:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184203776:0@lo:400:kworker.0 00010000:00080000:2.0:1788581360.483743:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d439db480 x1875463184204288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581360.483751:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184204288:0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.484310:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184203648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.484373:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581360.484426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184204160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.484455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581360.484492:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184204672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581360.484869:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581360.484923:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204672 00000100:00100000:3.0:1788581360.484931:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204672 00000100:00100000:3.0:1788581360.485292:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788581360.485302:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184204672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581360.485325:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581360.485372:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184204672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581360.485379:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788581360.485400:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204160 00000100:00100000:2.0:1788581360.485406:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204160 00000100:00100000:3.0:1788581360.485432:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184204672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581360.485459:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788581360.485469:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184204160:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788581360.485477:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581360.485483:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581360.485513:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184204160:12345-0@lo:400:kworker.0 Request processed in 48us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.485521:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788581360.485625:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184204160:0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.486456:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184203648 00000100:00100000:0.0:1788581360.486465:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184203648 00000100:00100000:0.0:1788581360.486636:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788581360.486645:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184203648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581360.486830:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184203648:12345-0@lo:400:kworker.0 Request processed in 186us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581360.486837:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788581360.486889:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184203648:0@lo:400:kworker.0 00000100:00080000:3.0:1788581360.487440:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581360.488495:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184203520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.488560:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184204032:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.488629:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581360.488690:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184204544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581360.488718:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581360.488857:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204032 00000100:00100000:3.0:1788581360.488865:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204032 00000100:00100000:3.0:1788581360.488937:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204544 00000100:00100000:3.0:1788581360.488941:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204544 00000100:00100000:2.0:1788581360.488956:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788581360.488966:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788581360.488971:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581360.488987:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184204544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.489055:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184204032:12345-0@lo:400:kworker.0 Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581360.489058:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184204544:12345-0@lo:400:kworker.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581360.489066:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788581360.489379:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184204032:0@lo:400:kworker.0 00000100:00100000:2.0:1788581360.489389:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184204544:0@lo:400:kworker.0 00000100:00080000:1.0:1788581360.489477:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581360.490898:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:3.0:1788581361.350789:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581361.478149:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184204800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581361.478326:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581361.478558:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204800 00000100:00100000:0.0:1788581361.478569:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204800 00000100:00100000:0.0:1788581361.478666:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581361.478679:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184204800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581361.478754:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581361.478828:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184204800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581361.478836:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788581361.479226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184204800:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788581362.369566:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581363.393477:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581363.527953:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184204928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581363.528062:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581363.528221:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184204928 00000100:00100000:2.0:1788581363.528231:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184204928 00000100:00100000:2.0:1788581363.528780:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788581363.528794:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184204928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581363.528834:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581363.528901:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184204928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581363.528909:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788581363.528937:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581363.528983:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184204928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581363.529216:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184205056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581363.529390:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581363.531607:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205056 00000100:00100000:2.0:1788581363.531629:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205056 00000100:00100000:2.0:1788581363.531883:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788581363.531897:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184205056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581363.531933:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581363.532050:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184205056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581363.532059:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788581363.532127:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184205056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581363.532378:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788581364.039912:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1788581364.039944:0:9486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788581364.040197:0:8400:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788581364.043042:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788581364.043098:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e50bd4180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788581364.043106:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995d4225e400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e4f290300 00000020:00080000:3.0:1788581364.043111:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995d4225e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995e7a698c00 00000020:00080000:3.0:1788581364.043139:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788581364.043218:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043234:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043244:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043251:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581364.043297:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043307:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043332:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff995d4233d200) 00010000:00010000:1.0:1788581364.043335:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581364.043343:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581364.043350:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b30b9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788581364.044326:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788581364.044472:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788581364.047512:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184205184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581364.047605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581364.048462:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205184 00000100:00100000:2.0:1788581364.048475:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205184 00000100:00100000:2.0:1788581364.048544:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788581364.048555:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184205184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581364.048600:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788581364.048682:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184205184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581364.048690:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788581364.049096:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184205184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788581364.420299:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581365.445199:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581365.484440:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484489:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484546:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484565:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484625:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581365.484661:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534272 00000100:00100000:3.0:1788581365.484675:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534272 00000100:00100000:3.0:1788581365.484738:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 388 00000100:00100000:3.0:1788581365.484753:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170534272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581365.484869:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2396:x1875463170534272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.484878:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 388 00000100:00100000:3.0:1788581365.484920:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534528 00000100:00100000:3.0:1788581365.484924:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534528 00000100:00100000:3.0:1788581365.485004:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535040 00000100:00100000:3.0:1788581365.485008:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535040 00000100:00100000:3.0:1788581365.485039:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534400 00000100:00100000:3.0:1788581365.485043:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534400 00000100:00100000:3.0:1788581365.485059:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534912 00000100:00100000:3.0:1788581365.485062:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534912 00000100:00100000:3.0:1788581365.485079:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 317 00000100:00100000:3.0:1788581365.485085:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170534528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581365.485121:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170534528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.485129:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 317 00000100:00100000:3.0:1788581365.485143:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 318 00000100:00100000:3.0:1788581365.485150:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170535040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581365.485177:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170535040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.485184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 318 00000100:00100000:3.0:1788581365.485197:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 319 00000100:00100000:3.0:1788581365.485203:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170534400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581365.485237:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2396:x1875463170534400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.485296:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 319 00000100:00100000:3.0:1788581365.485309:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00100000:3.0:1788581365.485316:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581365.485344:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170534912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.485350:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00080000:1.0:1788581365.486349:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581365.486358:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581365.487519:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534784 00000100:00100000:0.0:1788581365.487538:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534784 00000100:00100000:0.0:1788581365.488535:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170534656 00000100:00100000:0.0:1788581365.488546:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170534656 00000100:00100000:0.0:1788581365.489478:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1788581365.489497:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170534784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581365.489620:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2396:x1875463170534784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 126us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581365.489631:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1788581365.489663:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:0.0:1788581365.489670:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170534656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581365.489698:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2396:x1875463170534656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581365.489704:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00080000:3.0:1788581365.489967:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581365.489973:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581365.569815:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184205696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.569906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581365.570053:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184205312:0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.570099:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.570177:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184206208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.570210:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.570232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184206720:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.570294:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581365.571970:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205696 00000100:00100000:3.0:1788581365.571994:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205696 00000100:00100000:3.0:1788581365.572079:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788581365.572091:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184205696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.572205:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184205696:12345-0@lo:400:kworker.0 Request processed in 116us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.572214:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788581365.572279:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184205568:0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.572326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581365.572768:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205312 00000100:00100000:1.0:1788581365.572775:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205312 00000100:00100000:2.0:1788581365.572921:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184205696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.572983:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206208 00000100:00100000:2.0:1788581365.572987:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206208 00000100:00100000:2.0:1788581365.573050:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206720 00000100:00100000:2.0:1788581365.573053:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206720 00000100:00100000:2.0:1788581365.573079:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788581365.573089:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184206208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.573151:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184206208:12345-0@lo:400:kworker.0 Request processed in 64us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.573159:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788581365.573174:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788581365.573181:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184206720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.573212:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184206720:12345-0@lo:400:kworker.0 Request processed in 32us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.573217:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788581365.573242:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205568 00000100:00100000:2.0:1788581365.573245:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205568 00000100:00100000:2.0:1788581365.573316:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788581365.573322:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184205568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.573361:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184205568:12345-0@lo:400:kworker.0 Request processed in 39us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.573366:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1788581365.573704:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581365.573711:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581365.573849:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184206208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.573863:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184206720:0@lo:400:kworker.0 00000100:00100000:0.0:1788581365.574230:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788581365.574239:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184205312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581365.574328:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3619:x1875463184205312:12345-0@lo:400:kworker.0 Request processed in 90us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581365.574335:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788581365.575027:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184205568:0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.575047:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184206080:0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.575106:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581365.575159:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184206592:0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.575184:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581365.575216:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184207104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581365.575247:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.575340:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206080 00000100:00100000:2.0:1788581365.575349:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206080 00000100:00080000:1.0:1788581365.575643:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581365.575674:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206592 00000100:00100000:2.0:1788581365.575677:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206592 00000100:00100000:2.0:1788581365.575709:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788581365.575719:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.575777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184206080:12345-0@lo:400:kworker.0 Request processed in 60us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.575785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788581365.575800:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788581365.575811:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184206592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.575839:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184206592:12345-0@lo:400:kworker.0 Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.575845:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788581365.575890:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581365.576069:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184205440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.576104:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.576137:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184205952:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.576160:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.576240:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184206464:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.576292:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788581365.576399:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d439d9500 x1875463184206080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581365.576426:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184206080:0@lo:400:kworker.0 00010000:00080000:3.0:1788581365.576439:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb34a80 x1875463184206592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581365.576447:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184206592:0@lo:400:kworker.0 00000100:00100000:3.0:1788581365.576473:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207104 00000100:00100000:3.0:1788581365.576478:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207104 00000100:00100000:3.0:1788581365.576522:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581365.576542:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184207104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581365.576571:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581365.576612:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184207104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581365.576619:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788581365.576908:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184206976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581365.576938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581365.577084:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205440 00000100:00100000:1.0:1788581365.577089:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205440 00000100:00100000:1.0:1788581365.577120:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205952 00000100:00100000:1.0:1788581365.577123:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205952 00000100:00100000:1.0:1788581365.577139:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206464 00000100:00100000:1.0:1788581365.577142:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206464 00000100:00100000:1.0:1788581365.577157:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788581365.577165:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184205440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.577213:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184205440:12345-0@lo:400:kworker.0 Request processed in 50us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581365.577219:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788581365.577233:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788581365.577240:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.577285:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184205952:12345-0@lo:400:kworker.0 Request processed in 46us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581365.577292:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788581365.577303:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788581365.577309:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184206464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.577348:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184206464:12345-0@lo:400:kworker.0 Request processed in 39us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581365.577354:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:1.0:1788581365.577376:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581365.577380:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581365.577439:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184205440:0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.577451:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184205952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581365.577460:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184206464:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.577710:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206976 00000100:00100000:2.0:1788581365.577716:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206976 00000100:00100000:2.0:1788581365.577757:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788581365.577765:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184206976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581365.577781:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788581365.577820:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184206976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.577826:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788581365.577869:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3619:1875463184205312:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.577880:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184205824:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.577912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.577937:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184206336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.577982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.578004:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184206848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578029:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581365.578071:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184205824 00000100:00100000:2.0:1788581365.578075:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184205824 00000100:00100000:2.0:1788581365.578105:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788581365.578111:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184205824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578150:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184205824:12345-0@lo:400:kworker.0 Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.578169:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788581365.578189:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206336 00000100:00100000:2.0:1788581365.578193:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206336 00000100:00100000:2.0:1788581365.578223:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184206848 00000100:00100000:2.0:1788581365.578226:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184206848 00000100:00100000:2.0:1788581365.578244:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788581365.578250:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184206336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578313:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184206336:12345-0@lo:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.578319:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788581365.578502:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788581365.578509:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184206848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578745:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184206848:12345-0@lo:400:kworker.0 Request processed in 235us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581365.578752:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788581365.578811:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184205824:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578821:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788581365.578828:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995d43be2680, transno 4294967311 00000100:00100000:2.0:1788581365.578845:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184206336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.578855:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788581365.578860:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788581365.578879:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184206848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581365.579150:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184207104:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788581365.579239:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581365.579294:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184206976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581366.182718:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581366.183347:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535168 00000100:00100000:1.0:1788581366.183358:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535168 00000100:00100000:1.0:1788581366.183427:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:1.0:1788581366.183439:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12133:x1875463170535168:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788581366.183542:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12133:x1875463170535168:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 106us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581366.183549:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:0.0:1788581366.188233:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581366.188766:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535296 00000100:00100000:3.0:1788581366.188782:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535296 00000100:00100000:3.0:1788581366.188862:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00100000:3.0:1788581366.188877:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:12133:x1875463170535296:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788581366.189038:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:12133:x1875463170535296:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 164us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581366.189046:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00100000:3.0:1788581366.192355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581366.192445:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535552 00000100:00100000:2.0:1788581366.192480:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535552 00000100:00100000:2.0:1788581366.192553:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:2.0:1788581366.192566:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:12133:x1875463170535552:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788581366.192889:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:12133:x1875463170535552:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 324us (547us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788581366.192899:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1788581366.393720:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581366.394017:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535680 00000100:00100000:3.0:1788581366.394032:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535680 00000100:00100000:3.0:1788581366.394123:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 257 00000100:00100000:3.0:1788581366.394137:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:12931:x1875463170535680:12345-192.168.203.3@tcp:101:lsof.0 00010000:00010000:3.0:1788581366.394188:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581366.394217:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30c26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2238a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394365:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394382:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394711:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581366.394857:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581366.394862:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581366.394896:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394930:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b30c26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2238a expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394954:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2238a expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581366.394964:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:3.0:1788581366.394967:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581366.394983:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980800, rc 0) 00000100:00100000:3.0:1788581366.395135:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:12931:x1875463170535680:12345-192.168.203.3@tcp:101:lsof.0 Request processed in 1000us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581366.395144:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 257 00010000:00010000:0.0:1788581366.468654:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581366.599135:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581366.599172:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184207232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581366.599300:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581366.599632:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207232 00000100:00100000:0.0:1788581366.599643:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207232 00000100:00100000:0.0:1788581366.599704:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788581366.599714:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184207232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581366.599893:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788581366.599961:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184207232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581366.599977:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788581366.600098:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184207232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581367.489753:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581368.517588:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581368.642591:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184207488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581368.642696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581368.642751:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581368.642769:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581368.642807:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581368.642841:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207488 00000100:00100000:2.0:1788581368.642851:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207488 00000100:00100000:2.0:1788581368.642920:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207360 00000100:00100000:2.0:1788581368.642924:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207360 00000100:00080000:0.0:1788581368.642943:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581368.642944:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788581368.642954:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184207488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581368.643013:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581368.643073:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184207488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581368.643081:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788581368.643103:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788581368.643109:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184207360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581368.643119:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788581368.643149:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184207360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581368.643178:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788581368.643232:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184207488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581368.643297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581369.154586:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184207616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581369.154711:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581369.154798:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207616 00000100:00100000:3.0:1788581369.154808:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207616 00000100:00100000:3.0:1788581369.154875:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788581369.154888:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184207616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581369.154934:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788581369.155013:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184207616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581369.155029:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788581369.155376:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184207616:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788581369.282061:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788581369.537563:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581369.537578:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581369.537720:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1788581369.537728:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788581369.538547:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788581369.552602:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788581369.552628:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788581369.554383:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788581369.554405:0:6525:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788581370.563641:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581370.587902:0:14876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:09:28 (1788581368) 00000100:00100000:3.0:1788581370.602275:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581370.602350:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581370.602391:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535808 00000100:00100000:3.0:1788581370.602407:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581370.602409:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535808 00000100:00100000:3.0:1788581370.602439:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581370.602467:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581370.602496:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581370.602499:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 390 00000100:00100000:1.0:1788581370.602516:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2393:x1875463170535808:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581370.602532:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581370.602563:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536320 00000100:00100000:3.0:1788581370.602568:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536320 00000100:00100000:1.0:1788581370.602632:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2393:x1875463170535808:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.602634:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536192 00000100:00100000:3.0:1788581370.602639:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536192 00000100:00100000:1.0:1788581370.602670:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 390 00000100:00100000:3.0:1788581370.602694:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1788581370.602704:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170536320:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581370.602745:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2393:x1875463170536320:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.602752:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1788581370.602767:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1788581370.602776:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170536192:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581370.602804:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170536192:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.602810:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1788581370.602830:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536064 00000100:00100000:3.0:1788581370.602834:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536064 00000100:00100000:3.0:1788581370.602866:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536576 00000100:00100000:3.0:1788581370.602870:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536576 00000100:00100000:3.0:1788581370.602885:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170535936 00000100:00100000:3.0:1788581370.602887:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170535936 00000100:00100000:3.0:1788581370.602903:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536448 00000100:00100000:3.0:1788581370.602906:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536448 00000100:00100000:3.0:1788581370.602920:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:3.0:1788581370.602926:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170536064:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581370.602954:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:2.0:1788581370.602968:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2393:x1875463170536576:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581370.602987:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2393:x1875463170536064:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 59us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.602995:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:2.0:1788581370.603006:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2393:x1875463170536576:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.603013:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:3.0:1788581370.603021:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2393:x1875463170535936:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581370.603056:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:2393:x1875463170535936:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581370.603175:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:2.0:1788581370.603197:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:2.0:1788581370.603204:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2393:x1875463170536448:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581370.603248:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2393:x1875463170536448:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 44us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581370.603292:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00080000:2.0:1788581370.603352:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581370.603357:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581370.603360:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581370.603362:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581370.603420:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:0.0:1788581370.689428:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184207744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581370.689529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581370.689617:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581370.689625:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184207872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581370.689660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581370.689715:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207744 00000100:00100000:0.0:1788581370.689726:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207744 00000100:00100000:0.0:1788581370.689784:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788581370.689798:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184207744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581370.689861:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184207744:12345-0@lo:400:kworker.0 Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581370.689870:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788581370.689912:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184207872 00000100:00100000:0.0:1788581370.689916:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184207872 00000100:00100000:0.0:1788581370.689969:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788581370.689976:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184207872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581370.690005:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788581370.690043:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184207872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581370.690049:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788581370.690073:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581370.690119:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184207872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581370.690131:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184207744:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.691282:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184208000:0@lo:400:kworker.0 00000100:00100000:1.0:1788581370.691410:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184208384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.695805:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581370.695892:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184208512:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.695933:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581370.695971:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184209024:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.696012:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581370.696053:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581370.696063:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184208128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.696586:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208000 00000100:00100000:3.0:1788581370.696601:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208000 00000100:00100000:3.0:1788581370.696674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208512 00000100:00100000:3.0:1788581370.696678:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208512 00000100:00100000:3.0:1788581370.696715:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209024 00000100:00100000:3.0:1788581370.696718:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209024 00000100:00100000:3.0:1788581370.696743:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788581370.696756:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184208000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.696850:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184208000:12345-0@lo:400:kworker.0 Request processed in 97us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.696860:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788581370.696885:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788581370.696892:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184208512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.696924:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184208512:12345-0@lo:400:kworker.0 Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.696931:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788581370.696953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788581370.696960:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184209024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.696989:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184209024:12345-0@lo:400:kworker.0 Request processed in 29us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.696995:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:3.0:1788581370.697026:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581370.697300:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.697350:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184208256:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.697510:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184208640:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.697574:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581370.698231:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184209152:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698526:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581370.698585:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184208000:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698617:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184208512:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698631:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184209024:0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698690:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208640 00000100:00100000:2.0:1788581370.698702:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208640 00000100:00100000:2.0:1788581370.698761:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209152 00000100:00100000:2.0:1788581370.698765:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209152 00000100:00100000:2.0:1788581370.698783:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788581370.698791:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184208640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698842:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184208640:12345-0@lo:400:kworker.0 Request processed in 51us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581370.698849:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788581370.698865:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788581370.698870:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184209152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.698895:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184209152:12345-0@lo:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581370.698916:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:2.0:1788581370.698961:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a97800 x1875463184208640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581370.698972:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184208640:0@lo:400:kworker.0 00010000:00080000:2.0:1788581370.698983:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a96680 x1875463184209152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581370.698992:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184209152:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.699685:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.699734:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184208768:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.699785:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.699813:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209280:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.699837:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.699873:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581370.699880:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581370.699906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.699968:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208128 00000100:00100000:3.0:1788581370.700000:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208128 00000100:00100000:3.0:1788581370.700058:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788581370.700069:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184208128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.700132:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184208128:12345-0@lo:400:kworker.0 Request processed in 64us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.700141:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788581370.700166:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208768 00000100:00100000:3.0:1788581370.700170:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208768 00000100:00100000:3.0:1788581370.700199:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209280 00000100:00100000:3.0:1788581370.700203:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209280 00000100:00100000:3.0:1788581370.700228:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581370.700235:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184208768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.700301:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184208768:12345-0@lo:400:kworker.0 Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.700308:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581370.700320:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581370.700326:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.700590:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208256 00000100:00100000:2.0:1788581370.700607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208256 00000100:00100000:2.0:1788581370.700687:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788581370.700704:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184208256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581370.700820:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184208256:12345-0@lo:400:kworker.0 Request processed in 122us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581370.700827:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788581370.701471:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209280:12345-0@lo:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.701487:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581370.701542:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209408 00000100:00100000:3.0:1788581370.701550:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209408 00000100:00100000:3.0:1788581370.701587:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788581370.701595:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581370.701617:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581370.701674:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.701681:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1788581370.701723:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581370.701729:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581370.701734:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581370.701789:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184208128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.701842:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581370.701854:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184208256:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.701865:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184208768:0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.701874:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209280:0@lo:400:kworker.0 00000100:00100000:1.0:1788581370.703084:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.703502:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208384 00000100:00100000:3.0:1788581370.703515:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208384 00000100:00100000:3.0:1788581370.703571:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788581370.703582:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184208384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.703685:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184208384:12345-0@lo:400:kworker.0 Request processed in 103us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.703693:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788581370.703823:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184208384:0@lo:400:kworker.0 00000100:00100000:1.0:1788581370.703839:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184208896:0@lo:400:kworker.0 00000100:00100000:1.0:1788581370.703893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581370.704547:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184208896 00000100:00100000:3.0:1788581370.704557:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184208896 00000100:00100000:3.0:1788581370.704644:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788581370.704653:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184208896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581370.704724:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184208896:12345-0@lo:400:kworker.0 Request processed in 72us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581370.704731:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788581370.708158:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581370.708231:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184208896:0@lo:400:kworker.0 00010000:00010000:2.0:1788581371.588741:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581371.722768:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581371.722804:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184209536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581371.722927:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581371.723030:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209536 00000100:00100000:1.0:1788581371.723041:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209536 00000100:00100000:1.0:1788581371.723105:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788581371.723116:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184209536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581371.723166:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581371.723218:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184209536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581371.723227:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788581371.723323:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184209536:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581372.619313:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581373.635898:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581373.761949:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184209664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581373.762067:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581373.762305:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209664 00000100:00100000:1.0:1788581373.762316:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209664 00000100:00100000:1.0:1788581373.762396:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788581373.762409:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184209664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581373.762468:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788581373.762525:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184209664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581373.762533:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788581373.762599:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184209664:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788581373.762886:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581373.763562:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184209792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581373.763635:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581373.763805:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209792 00000100:00100000:0.0:1788581373.763814:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209792 00000100:00100000:0.0:1788581373.763878:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788581373.763888:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184209792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581373.763911:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581373.763971:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184209792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581373.763994:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788581373.764058:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184209792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581373.764247:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581374.274885:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581374.274917:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581374.275042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581374.275353:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184209920 00000100:00100000:3.0:1788581374.275364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184209920 00000100:00100000:3.0:1788581374.275437:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788581374.275449:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581374.275491:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788581374.275558:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184209920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581374.275567:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788581374.275705:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184209920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788581374.657549:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581375.421644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581375.425108:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170536832 00000100:00100000:2.0:1788581375.425131:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170536832 00000100:00100000:2.0:1788581375.425882:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1788581375.425907:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+18:13155:x1875463170536832:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:2.0:1788581375.426292:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:13155:x1875463170536832:12345-192.168.203.3@tcp:35:umount.0 Request processed in 397us (4662us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788581375.426301:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00080000:3.0:1788581375.427374:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581375.430437:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581375.430566:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537088 00000100:00100000:2.0:1788581375.430597:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537088 00000100:00100000:2.0:1788581375.430879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1788581375.430894:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+19:13155:x1875463170537088:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:2.0:1788581375.431382:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:13155:x1875463170537088:12345-192.168.203.3@tcp:35:umount.0 Request processed in 488us (957us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788581375.431393:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1788581375.444646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581375.444795:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537344 00000100:00100000:3.0:1788581375.444810:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537344 00000100:00100000:3.0:1788581375.444911:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:3.0:1788581375.444932:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4eb4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+20:13155:x1875463170537344:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:3.0:1788581375.445301:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4eb4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:13155:x1875463170537344:12345-192.168.203.3@tcp:35:umount.0 Request processed in 371us (670us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788581375.445330:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1788581375.448832:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581375.449558:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537600 00000100:00100000:3.0:1788581375.449574:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537600 00000100:00100000:3.0:1788581375.449646:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1788581375.449658:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:13155:x1875463170537600:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:3.0:1788581375.450466:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:13155:x1875463170537600:12345-192.168.203.3@tcp:35:umount.0 Request processed in 342us (1181us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788581375.450477:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1788581375.467577:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581375.467640:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581375.467670:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581375.467704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581375.467747:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170538368 00000100:00100000:1.0:1788581375.467761:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170538368 00000100:00100000:1.0:1788581375.467841:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1788581375.468033:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537728 00000100:00100000:2.0:1788581375.468038:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537728 00000100:00100000:2.0:1788581375.468080:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537984 00000100:00100000:2.0:1788581375.468082:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537984 00000100:00100000:2.0:1788581375.468093:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170537856 00000100:00100000:2.0:1788581375.468095:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170537856 00000100:00100000:2.0:1788581375.468107:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581375.468115:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+15:2395:x1875463170537728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581375.468135:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581375.468170:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b2fb86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21edd expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.468193:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581375.468297:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+14:2395:x1875463170537728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 182us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.468306:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581375.468329:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1788581375.468336:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+13:2395:x1875463170537984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581375.468565:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581375.468578:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b2fe57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fb6 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.468612:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581375.468634:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+12:2395:x1875463170537984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 299us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.468641:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1788581375.468654:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1788581375.468660:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2395:x1875463170537856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581375.468668:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581375.468678:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272a00/0x50f0cc74b7b2fb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21e9e expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.468687:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581375.468702:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2395:x1875463170537856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 43us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.468709:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00080000:2.0:1788581375.468766:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581375.470228:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+7:2392:x1875463170538368:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:1.0:1788581375.470293:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30198 00000020:00010000:1.0:1788581375.470305:0:8409:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995d43a87800: total 0 00000100:00080000:1.0:1788581375.470310:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995d43a85000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788581375.470446:0:6482:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995d43a87800: total 0 00010000:00010000:2.0:1788581375.470524:0:6482:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995d43a87800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788581375.470598:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b30550 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221a0 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788581375.470764:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:2.0:1788581375.472307:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b30c1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22383 expref: 4 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.472336:0:6482:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995d43a87800, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1788581375.472518:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c1c238-f3ab-41d9-b90e-c3af2be29807+3:2392:x1875463170538368:12345-192.168.203.3@tcp:9:umount.0 Request processed in 2384us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581375.472532:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00010000:00010000:2.0:1788581375.472644:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581375.472671:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581375.472674:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581375.485399:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581375.485851:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170538496 00000100:00100000:3.0:1788581375.485937:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170538496 00000100:00100000:3.0:1788581375.486105:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1788581375.486120:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2392:x1875463170538496:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:3.0:1788581375.486163:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2ff22 00000100:00080000:3.0:1788581375.486174:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e7fb22800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581375.486235:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788581375.486495:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+2:2392:x1875463170538496:12345-192.168.203.3@tcp:9:umount.0 Request processed in 378us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.486504:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00010000:00010000:3.0:1788581375.486532:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581375.487207:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581375.500362:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581375.504876:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170539520 00000100:00100000:2.0:1788581375.504902:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170539520 00000100:00100000:2.0:1788581375.505012:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 258 00000100:00100000:2.0:1788581375.505026:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+22:2392:x1875463170539520:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:2.0:1788581375.505416:0:6495:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb55 00000020:00010000:2.0:1788581375.505439:0:6495:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995d42c3c000: total 0 00000100:00080000:2.0:1788581375.505445:0:6495:0:(import.c:65:import_set_state_nolock()) ffff995d42c3e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788581375.505488:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788581375.505831:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c1c238-f3ab-41d9-b90e-c3af2be29807+21:2392:x1875463170539520:12345-192.168.203.3@tcp:39:umount.0 Request processed in 803us (5481us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788581375.505843:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 258 00000020:00010000:3.0:1788581375.506311:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995d42c3c000: total 0 00010000:00010000:3.0:1788581375.506470:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995d42c3c000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788581375.506515:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4233c000) 00010000:00010000:3.0:1788581375.506519:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581375.506529:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b2fe81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fc4 expref: 20 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.506583:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581375.506586:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788581375.506590:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71400/0x50f0cc74b7b305d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221c3 expref: 19 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.512424:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581375.512444:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581375.512468:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44000/0x50f0cc74b7b30be0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2236e expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.512530:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:3.0:1788581375.512533:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581375.512539:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a800/0x50f0cc74b7b30431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22153 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.512558:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581375.512561:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788581375.512565:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6ae00/0x50f0cc74b7b2fef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fe0 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.512582:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff995e6f934200) 00010000:00010000:3.0:1788581375.512585:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581375.512590:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b308c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2229c expref: 15 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.513251:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:3.0:1788581375.513280:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581375.513314:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b305b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df221bc expref: 14 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581375.513800:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:3.0:1788581375.513806:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788581375.513812:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44c00/0x50f0cc74b7b30c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2237c expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.514138:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581375.514142:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581375.515245:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a200/0x50f0cc74b7b30511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2218b expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.515789:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff995e6f92ac00) 00010000:00010000:2.0:1788581375.515793:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581375.515799:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b30b00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22336 expref: 11 pid: 11562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.515823:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff995e6f928b00) 00010000:00010000:2.0:1788581375.515825:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788581375.515829:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b3053b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22199 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.516305:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581375.516308:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581375.516314:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b301f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df220b9 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581375.516672:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6f928100) 00010000:00010000:2.0:1788581375.516676:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581375.516681:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980000/0x50f0cc74b7b2fe9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21fcb expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581375.517062:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995d42c3c000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788581375.517114:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581375.517117:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581375.517121:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581375.521308:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581375.521432:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170539648 00000100:00100000:3.0:1788581375.521446:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170539648 00000100:00100000:3.0:1788581375.521542:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:3.0:1788581375.521556:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+5:2392:x1875463170539648:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:3.0:1788581375.521602:0:9504:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb5c 00000100:00080000:0.0:1788581375.521615:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581375.521626:0:9504:0:(import.c:65:import_set_state_nolock()) ffff995d41e5b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788581375.521906:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788581375.531189:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788581375.532856:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c1c238-f3ab-41d9-b90e-c3af2be29807+3:2392:x1875463170539648:12345-192.168.203.3@tcp:39:umount.0 Request processed in 11287us (11545us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788581375.532876:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 259 00010000:00010000:3.0:1788581375.683721:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581375.721844:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581375.721907:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581375.722142:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170539776 00000100:00100000:3.0:1788581375.722157:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170539776 00000100:00100000:3.0:1788581375.722248:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170539904 00000100:00100000:3.0:1788581375.722287:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170539904 00000100:00100000:3.0:1788581375.722316:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 337 00000100:00100000:3.0:1788581375.722328:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170539776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581375.722424:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2396:x1875463170539776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 99us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.722433:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 337 00000100:00100000:3.0:1788581375.722453:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00100000:3.0:1788581375.722459:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170539904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581375.722480:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2396:x1875463170539904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.722496:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00080000:2.0:1788581375.722578:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581375.722584:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581375.809615:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581375.813789:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581375.813825:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184210176:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.813952:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581375.814089:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210176 00000100:00100000:0.0:1788581375.814100:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210176 00000100:00100000:0.0:1788581375.814181:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788581375.814193:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184210176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.814286:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184210176:12345-0@lo:400:kworker.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581375.814322:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788581375.814393:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184210176:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.818436:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184210048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581375.818552:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581375.820233:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210048 00000100:00100000:0.0:1788581375.820302:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210048 00000100:00100000:0.0:1788581375.820414:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788581375.820432:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184210048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581375.820477:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788581375.820585:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184210048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581375.820594:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788581375.820969:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581375.821043:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184210048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581375.821439:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581375.821457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184210304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581375.821524:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.822443:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210304 00000100:00100000:3.0:1788581375.822460:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210304 00000100:00100000:3.0:1788581375.822567:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788581375.822582:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184210304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581375.822618:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581375.822718:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184210304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.822726:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788581375.822834:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184210304:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788581375.823112:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581375.825591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184210816:0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.825700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.825758:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184211328:0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.825789:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.825816:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788581375.825823:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184210432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.825851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.825868:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184210944:0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.825889:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.825994:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184211456:0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.826016:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581375.826048:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210432 00000100:00100000:3.0:1788581375.826057:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210432 00000100:00100000:3.0:1788581375.826109:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210944 00000100:00100000:3.0:1788581375.826112:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210944 00000100:00100000:1.0:1788581375.826277:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184210688:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826315:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581375.826330:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184211200:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826352:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581375.826377:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211328 00000100:00100000:1.0:1788581375.826380:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211328 00000100:00100000:1.0:1788581375.826409:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211200 00000100:00100000:1.0:1788581375.826413:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211200 00000100:00100000:1.0:1788581375.826439:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788581375.826448:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184211328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826512:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184211328:12345-0@lo:400:kworker.0 Request processed in 64us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581375.826520:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788581375.826539:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788581375.826546:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184211200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826570:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184211200:12345-0@lo:400:kworker.0 Request processed in 25us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581375.826597:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788581375.826642:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184211200:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826665:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788581375.826671:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184210560:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826698:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581375.826716:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184211072:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826737:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581375.826748:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184211584:0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.826767:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581375.826814:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211456 00000100:00100000:1.0:1788581375.826819:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211456 00000100:00100000:1.0:1788581375.826838:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210688 00000100:00100000:1.0:1788581375.826841:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210688 00000100:00100000:1.0:1788581375.826851:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211072 00000100:00100000:1.0:1788581375.826853:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211072 00000100:00100000:3.0:1788581375.826987:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211584 00000100:00100000:3.0:1788581375.826991:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211584 00000100:00100000:3.0:1788581375.827027:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788581375.827035:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184210432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.827074:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184210432:12345-0@lo:400:kworker.0 Request processed in 40us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.827080:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788581375.827095:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788581375.827101:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184210944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.827131:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184210944:12345-0@lo:400:kworker.0 Request processed in 30us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.827137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788581375.827302:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788581375.827313:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184211456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.827355:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184211456:12345-0@lo:400:kworker.0 Request processed in 46us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581375.827362:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788581375.827422:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788581375.827430:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184210688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581375.827471:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184210688:12345-0@lo:400:kworker.0 Request processed in 42us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581375.827478:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788581375.827542:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210816 00000100:00100000:2.0:1788581375.827548:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210816 00000100:00100000:2.0:1788581375.827582:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184210560 00000100:00100000:2.0:1788581375.827585:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184210560 00000100:00100000:2.0:1788581375.827600:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788581375.827606:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184210816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581375.827650:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184210816:12345-0@lo:400:kworker.0 Request processed in 44us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.827656:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788581375.827671:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788581375.827677:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581375.827706:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184210560:12345-0@lo:400:kworker.0 Request processed in 30us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.827723:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788581375.827755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788581375.827763:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184211072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581375.827797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184211072:12345-0@lo:400:kworker.0 Request processed in 36us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581375.827803:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788581375.827852:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788581375.827860:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184211584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581375.827890:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875463184211584:12345-0@lo:400:kworker.0 Request processed in 32us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581375.827908:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:0.0:1788581375.833321:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581375.833334:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581375.833339:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581375.833418:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184210560:0@lo:400:kworker.0 00010000:00080000:0.0:1788581375.833440:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43be0000 x1875463184211072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581375.833453:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184211072:0@lo:400:kworker.0 00010000:00080000:0.0:1788581375.833466:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a95880 x1875463184211584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581375.833500:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833517:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184210688:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833579:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184210432:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833592:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184210944:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833605:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184211456:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833618:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184210816:0@lo:400:kworker.0 00000100:00100000:0.0:1788581375.833631:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184211328:0@lo:400:kworker.0 00010000:00010000:0.0:1788581376.705712:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581376.833804:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581376.833840:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184211712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581376.833978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581376.834702:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211712 00000100:00100000:1.0:1788581376.834719:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211712 00000100:00100000:1.0:1788581376.834807:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788581376.834820:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184211712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581376.834889:0:7450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788581376.834993:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184211712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581376.835020:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788581376.835190:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184211712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788581377.729523:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581377.906084:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581377.906141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581377.906194:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581377.906432:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540032 00000100:00100000:1.0:1788581377.906448:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540032 00000100:00100000:1.0:1788581377.906533:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540288 00000100:00100000:1.0:1788581377.906536:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540288 00000100:00100000:1.0:1788581377.906552:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540160 00000100:00100000:1.0:1788581377.906555:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540160 00000100:00100000:1.0:1788581377.906573:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1788581377.906586:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+12:2394:x1875463170540032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581377.906612:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581377.906643:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6ba00/0x50f0cc74b7b2fc58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ef2 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581377.906668:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581377.906744:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+11:2394:x1875463170540032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 160us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581377.906753:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1788581377.906785:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1788581377.906792:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+10:2394:x1875463170540288:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581377.906801:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581377.906810:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e200/0x50f0cc74b7b2fe50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21faf expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581377.906821:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581377.906839:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+9:2394:x1875463170540288:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 48us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581377.906846:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1788581377.906893:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1788581377.906909:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+8:2394:x1875463170540160:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581377.906918:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581377.906928:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e82160400/0x50f0cc74b7b2fc5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21f23 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581377.906940:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581377.906959:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dea27fd-4c26-4644-b718-43c4e0969f66+7:2394:x1875463170540160:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 50us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581377.906965:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581377.918578:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581377.919217:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540544 00000100:00100000:0.0:1788581377.919231:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540544 00000100:00100000:0.0:1788581377.919408:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:0.0:1788581377.919423:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+6:2392:x1875463170540544:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:0.0:1788581377.919479:0:9504:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fc6d 00000020:00010000:0.0:1788581377.919489:0:9504:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995d422bc800: total 0 00000100:00080000:0.0:1788581377.919495:0:9504:0:(import.c:65:import_set_state_nolock()) ffff995d422bf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581377.919524:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788581377.919772:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2392:x1875463170540544:12345-192.168.203.3@tcp:39:umount.0 Request processed in 340us (1195us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788581377.919803:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 260 00000020:00010000:3.0:1788581377.921414:0:10311:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995d422bc800: total 0 00010000:00010000:3.0:1788581377.921424:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581377.921511:0:10311:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995d422bc800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788581377.921563:0:10311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc800) 00010000:00010000:3.0:1788581377.921568:0:10311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581377.921581:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980800/0x50f0cc74b7b30c2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2238a expref: 4 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581377.921614:0:10311:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995d422bc800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788581377.921625:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581377.921627:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581377.921629:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581377.925290:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581377.930073:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581377.930251:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540672 00000100:00100000:0.0:1788581377.930297:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540672 00000100:00100000:0.0:1788581377.930408:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:0.0:1788581377.930421:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+5:2392:x1875463170540672:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:0.0:1788581377.930478:0:11562:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fc74 00000100:00080000:0.0:1788581377.930492:0:11562:0:(import.c:65:import_set_state_nolock()) ffff995d422b9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581377.930521:0:11562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788581377.930522:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581377.930734:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581377.931100:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4d3903fb-7514-43fd-b94a-0d806aeb9639+3:2392:x1875463170540672:12345-192.168.203.3@tcp:39:umount.0 Request processed in 678us (1039us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788581377.931111:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:0.0:1788581377.959938:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581377.960077:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170540928 00000100:00100000:1.0:1788581377.960091:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170540928 00000100:00100000:1.0:1788581377.960171:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 393 00000100:00100000:1.0:1788581377.960185:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+7:2392:x1875463170540928:12345-192.168.203.3@tcp:251:umount.0 00000020:00000080:1.0:1788581377.960315:0:6488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb32 00000020:00010000:1.0:1788581377.960327:0:6488:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995d42c38800: total 0 00000100:00080000:1.0:1788581377.960333:0:6488:0:(import.c:65:import_set_state_nolock()) ffff995d42c3b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788581377.960426:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dea27fd-4c26-4644-b718-43c4e0969f66+3:2392:x1875463170540928:12345-192.168.203.3@tcp:251:umount.0 Request processed in 244us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581377.960435:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 393 00000020:00010000:2.0:1788581377.960705:0:6482:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995d42c38800: total 0 00010000:00010000:2.0:1788581377.960778:0:6482:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995d42c38800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788581377.960820:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40030400/0x50f0cc74b7b2fb8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df21ee4 expref: 2 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581377.960838:0:6482:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995d42c38800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788581377.960848:0:6482:0:(genops.c:885:class_export_put()) final put ffff995d42c38800/9dea27fd-4c26-4644-b718-43c4e0969f66 00010000:00010000:2.0:1788581377.960870:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581377.960872:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581377.960874:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581377.960928:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c38800/9dea27fd-4c26-4644-b718-43c4e0969f66 for MGS 00000020:00000080:0.0:1788581377.960983:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c3b000 for MGS 00010000:00010000:3.0:1788581378.758461:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581378.882423:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184211840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581378.885734:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581378.885856:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581378.885872:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184211968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581378.885953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581378.886004:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211840 00000100:00100000:0.0:1788581378.886014:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211840 00000100:00100000:0.0:1788581378.886089:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184211968 00000100:00100000:0.0:1788581378.886092:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184211968 00000100:00100000:0.0:1788581378.886112:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788581378.886122:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184211840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581378.886172:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581378.886241:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184211840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581378.886249:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788581378.886296:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788581378.886302:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184211968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581378.886312:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788581378.887527:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581378.887610:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184211840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581378.890436:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184211968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4117us (4465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581378.890456:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788581378.890755:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184211968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581379.394958:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581379.394990:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184212096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581379.395091:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581379.395193:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212096 00000100:00100000:3.0:1788581379.395203:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212096 00000100:00100000:3.0:1788581379.397436:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788581379.397475:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184212096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581379.397535:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788581379.397650:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184212096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 193us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581379.402703:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184212096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581379.402970:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000040:00080000:2.0:1788581379.522618:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788581379.779015:0:13766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581379.779029:0:13766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1788581379.780154:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581379.781054:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788581379.781085:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:0.0:1788581380.025817:0:15071:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788581380.052558:0:15071:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788581380.052655:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.052673:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.052681:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.052689:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.052714:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788581380.052734:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788581380.052789:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581380.052795:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788581380.052804:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788581380.052843:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e4f10e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788581380.053008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184212224:0@lo:39:umount.0 00000100:00100000:1.0:1788581380.053080:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581380.053555:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212224 00000100:00100000:3.0:1788581380.053566:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212224 00000100:00100000:3.0:1788581380.053636:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788581380.053648:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875463184212224:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788581380.053682:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f749 00000100:00080000:3.0:1788581380.053692:0:6493:0:(import.c:65:import_set_state_nolock()) ffff995e71e3c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788581380.053819:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1875463184212224:12345-0@lo:39:umount.0 Request processed in 173us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581380.053829:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788581380.053841:0:6493:0:(genops.c:885:class_export_put()) final put ffff995e71e38000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788581380.053868:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581380.053878:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.053898:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581380.053903:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.053913:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581380.054249:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581380.054294:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e38000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581380.054361:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e71e3c800 for lustre-MDT0000 10000000:00010000:3.0:1788581380.054708:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581380.054723:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581380.054743:0:10311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788581380.054747:0:10311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788581380.054794:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.054801:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581380.054846:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.054854:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031400/0x50f0cc74b7b2fbe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.054868:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.054870:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.054872:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581380.056280:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f10e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788581380.056304:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184212224:0@lo:39:umount.0 00000100:00080000:3.0:1788581380.057912:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581380.057936:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788581380.057947:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788581380.059019:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581380.059057:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184212352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581380.059126:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059147:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059157:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059167:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581380.059175:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581380.059209:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581380.059244:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581380.059252:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059293:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581380.059298:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059310:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581380.059320:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581380.059326:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581380.059329:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788581380.059379:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059386:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581380.059413:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059420:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6a600/0x50f0cc74b7b2fbf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbfd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059437:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059440:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059442:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059457:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059485:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059491:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059498:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059509:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581380.059517:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059524:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059531:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059538:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059550:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581380.059558:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581380.059564:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059570:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581380.059579:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059586:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581380.059594:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581380.059600:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581380.059602:0:10311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788581380.059604:0:10311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788581380.059620:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059626:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581380.059632:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059639:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e400/0x50f0cc74b7b2faec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faf3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059649:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581380.059652:0:10311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059657:0:10311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581380.059660:0:10311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059667:0:10311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581380.059679:0:10311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581380.059684:0:10311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788581380.059686:0:10311:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581380.059688:0:10311:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788581380.059698:0:10311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059703:0:10311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581380.059723:0:10311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059729:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b2fe42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe49 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059742:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059748:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581380.059748:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212352 00010000:00010000:3.0:1788581380.059751:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581380.059760:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212352 00010000:00010000:3.0:1788581380.059767:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059778:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059785:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059791:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059816:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788581380.059820:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788581380.059825:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788581380.059870:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581380.059875:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059881:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c3c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581380.059897:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059905:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581380.059912:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581380.059917:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581380.059919:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788581380.059921:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788581380.059935:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059941:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581380.059947:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059954:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e429c3c00/0x50f0cc74b7b2f6a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f6af expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581380.059973:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059975:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581380.059976:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788581380.059992:0:15071:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788581380.059998:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788581380.060002:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581380.060010:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788581380.060017:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995d42c2c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581380.060024:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e81fc1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581380.060029:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e81fc4000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581380.060034:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e6f0de000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788581380.060042:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff995d422bc800 4d3903fb-7514-43fd-b94a-0d806aeb9639 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581380.060047:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff995d42c3c000 36c1c238-f3ab-41d9-b90e-c3af2be29807 192.168.203.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788581380.060052:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff995e71eb4d28) has exports, disconnecting them 00000020:00080000:3.0:1788581380.060057:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995d42c2c000), last request at 1788581375 00000020:00000080:3.0:1788581380.060065:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fa59 00000100:00080000:3.0:1788581380.060084:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995d42c2a000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581380.060122:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788581380.060134:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d42c2c000): rc 0 00000020:00000080:3.0:1788581380.060137:0:15071:0:(genops.c:885:class_export_put()) final put ffff995d42c2c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788581380.060146:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e81fc1000), last request at 1788581375 00000020:00000080:3.0:1788581380.060149:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f93a 00000100:00080000:3.0:1788581380.060154:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e6f0da000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581380.060161:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788581380.060166:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e81fc1000): rc 0 00000020:00000080:3.0:1788581380.060173:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e81fc1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788581380.060178:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e81fc4000), last request at 1788581164 00000020:00000080:3.0:1788581380.060181:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f830 00000100:00080000:3.0:1788581380.060185:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581380.060193:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788581380.060199:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e81fc4000): rc 0 00000020:00000080:3.0:1788581380.060201:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e81fc4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788581380.060204:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e6f0de000), last request at 1788581164 00000020:00000080:3.0:1788581380.060208:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7ff 00000100:00080000:3.0:1788581380.060211:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e6f0d8000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581380.060217:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788581380.060223:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788581380.060332:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e6f0de000): rc 0 00000004:00000080:3.0:1788581380.060339:0:15071:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffabf141bafae0 00000100:00080000:3.0:1788581380.060361:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788581380.060365:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788581380.060727:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581380.060750:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3620:x1875463184212352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581380.060771:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581380.060796:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273c00/0x50f0cc74b7b2fbef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbe8 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581380.060815:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581380.061173:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3620:x1875463184212352:12345-0@lo:103:ldlm_bl.0 Request processed in 432us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.061183:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581380.061201:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184212864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581380.061237:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184212480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581380.061347:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184212736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581380.061417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.061468:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581380.061476:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184212608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581380.061500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.061530:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212480 00000100:00100000:1.0:1788581380.061536:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212480 00000100:00100000:1.0:1788581380.061567:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212608 00000100:00100000:1.0:1788581380.061570:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212608 00000100:00100000:1.0:1788581380.061585:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581380.061591:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+24:3618:x1875463184212480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581380.061615:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581380.061640:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273a00/0x50f0cc74b7b2fbfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbf6 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581380.061652:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581380.061680:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+23:3618:x1875463184212480:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.061687:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581380.061699:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581380.061704:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+22:3618:x1875463184212608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581380.061712:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581380.061720:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b2faf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2faec expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581380.061730:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581380.061751:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3618:x1875463184212608:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.061756:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581380.061797:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184212608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581380.061806:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184212480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581380.070508:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581380.070652:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581380.070669:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c2c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581380.070739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81fc1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581380.070779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81fc4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581380.070808:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c2a000 for lustre-MDT0000 00000020:00000080:0.0:1788581380.070813:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f0da000 for lustre-MDT0000 00000020:00000080:0.0:1788581380.070817:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e81fc2000 for lustre-MDT0000 00000100:00100000:0.0:1788581380.070838:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212864 00000100:00100000:0.0:1788581380.070848:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212864 00000100:00100000:0.0:1788581380.070937:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581380.070949:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+21:3621:x1875463184212864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581380.070983:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581380.071029:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031c00/0x50f0cc74b7b2f6af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2f6a8 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581380.071048:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581380.071124:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3621:x1875463184212864:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581380.071132:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581380.071207:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3621:1875463184212864:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788581380.072233:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788581380.072294:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e6f8a7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788581380.072513:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788581380.072520:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788581380.072538:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788581380.072607:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788581380.072620:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e6f941000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788581380.072627:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788581380.072630:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788581380.072642:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788581380.072749:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788581380.072761:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184212992:0@lo:39:umount.0 00000100:00080000:3.0:1788581380.072763:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995d4328e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788581380.072820:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff995e71eb4d28) has no exports 00000100:00100000:1.0:1788581380.072872:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.072946:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184213120:0@lo:9:umount.0 00000100:00100000:1.0:1788581380.072972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.073005:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184213248:0@lo:9:umount.0 00000100:00100000:1.0:1788581380.073048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.073087:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213120 00000100:00100000:1.0:1788581380.074550:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213120 00000100:00100000:1.0:1788581380.074776:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213248 00000100:00100000:1.0:1788581380.074785:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213248 00000100:00100000:1.0:1788581380.074815:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581380.074826:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184213120:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788581380.075019:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f9db 00000100:00080000:1.0:1788581380.075031:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995e6f0df000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581380.075078:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788581380.075345:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3617:x1875463184213120:12345-0@lo:9:umount.0 Request processed in 520us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.075352:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581380.075368:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581380.075376:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184213248:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788581380.075388:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb1d 00000100:00080000:1.0:1788581380.075393:0:8409:0:(import.c:65:import_set_state_nolock()) ffff995d42c3c800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788581380.075564:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.075754:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184212352:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788581380.076094:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581380.076106:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581380.076305:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212992 00000100:00100000:3.0:1788581380.076319:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212992 00000100:00100000:3.0:1788581380.076398:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788581380.076410:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184212992:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788581380.076452:0:7450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f88b 00000100:00080000:3.0:1788581380.076463:0:7450:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581380.076491:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788581380.076709:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3617:x1875463184212992:12345-0@lo:39:umount.0 Request processed in 301us (3837us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788581380.076718:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000001:00000004:1.0:1788581380.076800:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788581380.078406:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3617:x1875463184213248:12345-0@lo:9:umount.0 Request processed in 3025us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.078419:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788581380.078465:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581380.078498:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d4328e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788581380.078518:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788581380.078520:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581380.078525:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184213248:0@lo:9:umount.0 00000100:00080000:1.0:1788581380.078542:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8a7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788581380.078546:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184212992:0@lo:39:umount.0 00000100:00080000:1.0:1788581380.078573:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f941000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788581380.078582:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788581380.078584:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581380.078587:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184213120:0@lo:9:umount.0 00010000:00010000:0.0:1788581380.079399:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581380.080319:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581380.080344:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184212736 00000100:00100000:1.0:1788581380.080355:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184212736 00000100:00100000:1.0:1788581380.081572:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581380.081592:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+20:3620:x1875463184212736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581380.081611:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581380.082750:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c3600/0x50f0cc74b7b2fe49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe42 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581380.082772:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581380.082866:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3620:x1875463184212736:12345-0@lo:103:ldlm_bl.0 Request processed in 1281us (7299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.082876:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581380.087426:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184212736:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788581380.109236:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff995e71eb4d28) has no exports 00000020:00000080:0.0:1788581380.202762:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f703 00000020:00000080:0.0:1788581380.202777:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e7a4a7800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788581380.202802:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788581380.202830:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a4a7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788581380.202920:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581380.202930:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788581380.202935:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff995e47874d28) has no exports 00000020:00000080:1.0:1788581380.203241:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f6fc 00000020:00000080:1.0:1788581380.203273:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e7a4a5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581380.203322:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581380.203330:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788581380.203333:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e47ae2800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788581380.203335:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e47ae2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788581380.203343:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788581380.203481:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a4a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788581380.801635:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581380.929533:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184213632:0@lo:400:kworker.0 00000100:00100000:2.0:1788581380.929609:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.929665:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184214144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581380.929693:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.929729:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581380.929735:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184213760:0@lo:400:kworker.0 00000100:00100000:2.0:1788581380.929760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.929777:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184214272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581380.929803:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.929839:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213632 00000100:00100000:2.0:1788581380.929846:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213632 00000100:00100000:3.0:1788581380.929869:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214144 00000100:00100000:3.0:1788581380.929885:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214144 00000100:00100000:2.0:1788581380.929896:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213760 00000100:00100000:2.0:1788581380.929901:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213760 00000100:00100000:3.0:1788581380.929906:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214272 00000100:00100000:3.0:1788581380.929911:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214272 00000100:00100000:2.0:1788581380.929924:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788581380.929932:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875463184213632:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788581380.929940:0:6494:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788581380.929946:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788581380.929956:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184214272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581380.929982:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875463184213632:12345-0@lo:400:kworker.0 Request processed in 48us (372us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788581380.929990:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788581380.930007:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184214272:12345-0@lo:400:kworker.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581380.930016:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788581380.930022:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788581380.930028:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875463184214144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581380.930038:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000020:00080000:2.0:1788581380.930039:0:6494:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788581380.930048:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184213760:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788581380.930055:0:6493:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788581380.930071:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875463184214144:12345-0@lo:400:kworker.0 Request processed in 40us (376us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788581380.930079:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788581380.930088:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184213760:12345-0@lo:400:kworker.0 Request processed in 39us (326us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581380.930095:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788581380.930117:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581380.930123:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788581380.930127:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788581380.930287:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930341:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.930365:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930388:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.930406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184214400:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930429:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.930448:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788581380.930454:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930476:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.930495:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184214016:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930518:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.930642:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213504 00000100:00100000:1.0:1788581380.930647:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213504 00000100:00100000:1.0:1788581380.930674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788581380.930679:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875463184213504:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788581380.930684:0:6498:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788581380.930715:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875463184213504:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581380.930721:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788581380.930740:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214400 00000100:00100000:1.0:1788581380.930743:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214400 00000100:00100000:1.0:1788581380.930768:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214016 00000100:00100000:1.0:1788581380.930771:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214016 00000100:00100000:1.0:1788581380.930790:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788581380.930797:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930831:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184214400:12345-0@lo:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.930838:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788581380.930856:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788581380.930862:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184214016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.930903:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184214016:12345-0@lo:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.930909:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788581380.930944:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788581380.930948:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788581380.930951:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788581380.930956:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581380.930960:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 150 00000100:00080000:1.0:1788581380.930965:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e81d97000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581380.930989:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d4339fb80 x1875463184214528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581380.931009:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.931023:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184214016:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.931032:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184214400:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.931054:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184214528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788581380.931077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581380.931103:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213888 00000100:00100000:1.0:1788581380.931107:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213888 00000100:00100000:1.0:1788581380.931130:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788581380.931136:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.931170:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184213888:12345-0@lo:400:kworker.0 Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581380.931184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00080000:1.0:1788581380.931213:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a95180 x1875463184213888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581380.931237:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788581380.931295:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214528 00000100:00100000:1.0:1788581380.931299:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214528 00000100:00100000:1.0:1788581380.931316:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788581380.931320:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184214528:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788581380.931333:0:6499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788581380.933610:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184214656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581380.933693:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581380.933766:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581380.933771:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581380.933774:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581380.933789:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184213376 00000100:00100000:0.0:1788581380.933795:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184213376 00000100:00100000:0.0:1788581380.933839:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788581380.933848:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3618:x1875463184213376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581380.933909:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f2bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a41bfcf2-194f-415a-ba31-00ecb4f1e60f+19:3618:x1875463184213376:12345-0@lo:400:kworker.0 Request processed in 60us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581380.933916:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788581380.933950:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214656 00000100:00100000:0.0:1788581380.933954:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214656 00000100:00100000:0.0:1788581380.933989:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581380.933996:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184214656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581380.934017:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788581380.934053:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184214656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581380.934060:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581380.934105:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184214656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581380.934156:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184213376:0@lo:400:kworker.0 00000001:00100000:0.0:1788581380.946130:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788581380.946150:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788581380.946158:0:7425:0:(genops.c:885:class_export_put()) final put ffff995e6fad8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788581380.946180:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00080000:0.0:1788581380.946185:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788581380.946187:0:7425:0:(genops.c:885:class_export_put()) final put ffff995d422bc000/4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00100000:0.0:1788581380.946192:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:00080000:0.0:1788581380.946196:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788581380.946197:0:7425:0:(genops.c:885:class_export_put()) final put ffff995e7fa4e800/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581380.947214:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fad8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1788581380.947215:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788581380.947224:0:8400:0:(genops.c:885:class_export_put()) final put ffff995e6f0db000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788581380.947292:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:0.0:1788581380.947297:0:8400:0:(genops.c:885:class_export_put()) final put ffff995e7fb22000/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581380.947361:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995d422bc000/4d3903fb-7514-43fd-b94a-0d806aeb9639 for lustre-MDT0001 00000020:00000080:3.0:1788581380.947396:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4e800/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-MDT0001 00000020:00000080:3.0:1788581380.947454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0db000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788581380.947474:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f8e0800 for lustre-MDT0001 00000020:00000080:3.0:1788581380.947479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb22000/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-OST0000 00000020:00000080:3.0:1788581380.947496:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d422b9000 for lustre-MDT0001 00000020:00000080:3.0:1788581380.947505:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d41e5b800 for lustre-MDT0001 00000001:00100000:0.0:1788581380.947510:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581380.947512:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f0df000 for lustre-OST0000 00000020:00000080:0.0:1788581380.947517:0:6472:0:(genops.c:885:class_export_put()) final put ffff995e6f0de000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581380.947520:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fb22800 for lustre-OST0000 00000020:00000080:3.0:1788581380.947533:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0de000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00100000:0.0:1788581380.947536:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4d3903fb-7514-43fd-b94a-0d806aeb9639 00000001:00080000:0.0:1788581380.947549:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788581380.947553:0:6472:0:(genops.c:885:class_export_put()) final put ffff995d422bc800/4d3903fb-7514-43fd-b94a-0d806aeb9639 00000020:00000080:3.0:1788581380.947583:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f0d8000 for lustre-MDT0000 00000020:00000080:3.0:1788581380.947591:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995d422bc800/4d3903fb-7514-43fd-b94a-0d806aeb9639 for lustre-MDT0000 00000020:00000080:3.0:1788581380.947609:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d422bf000 for lustre-MDT0000 00000001:00100000:0.0:1788581380.948112:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000001:00080000:0.0:1788581380.948122:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788581380.948133:0:6472:0:(genops.c:885:class_export_put()) final put ffff995d42c3c000/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581380.948237:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c3c000/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-MDT0000 00000020:00000080:3.0:1788581380.948399:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c3e000 for lustre-MDT0000 00000001:00100000:0.0:1788581380.951564:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788581380.951574:0:9486:0:(genops.c:885:class_export_put()) final put ffff995d42c39000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788581380.951603:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:0.0:1788581380.951606:0:9486:0:(genops.c:885:class_export_put()) final put ffff995d43a87800/36c1c238-f3ab-41d9-b90e-c3af2be29807 00000020:00000080:3.0:1788581380.951669:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c39000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788581380.951723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a87800/36c1c238-f3ab-41d9-b90e-c3af2be29807 for lustre-OST0001 00000020:00000080:3.0:1788581380.951756:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c3c800 for lustre-OST0001 00000020:00000080:3.0:1788581380.951762:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43a85000 for lustre-OST0001 00000100:00100000:1.0:1788581380.956924:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184214528:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 25591us (25835us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581380.956944:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788581380.959538:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581380.959558:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581380.959565:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184214528:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788581380.959940:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581380.959948:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 166 00000100:00080000:2.0:1788581380.959961:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a6d6000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581380.960016:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44071500 x1875463184214784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581380.960093:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184214784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788581380.960181:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581380.960293:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184213760:0@lo:400:kworker.0 00010000:00080000:2.0:1788581380.960330:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44070e00 x1875463184214272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581380.960342:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184214272:0@lo:400:kworker.0 00000100:00080000:2.0:1788581380.960357:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581380.960361:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788581380.960364:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788581380.960368:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581380.960372:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 150 00000100:00080000:2.0:1788581380.960396:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995e81fc2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581380.960412:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44072300 x1875463184214912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581380.960424:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184213632:0@lo:400:kworker.0 00000100:00080000:2.0:1788581380.960451:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581380.960454:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788581380.960457:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788581380.960460:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581380.960464:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 186 00000100:00080000:2.0:1788581380.960468:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995d42e9a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581380.960481:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44071c00 x1875463184215040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581380.960491:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184214144:0@lo:400:kworker.0 00000100:00100000:0.0:1788581380.960709:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184214912:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788581380.960739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581380.961081:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184215040:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788581380.961107:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581380.961153:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214784 00000100:00100000:3.0:1788581380.961161:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214784 00000100:00100000:3.0:1788581380.961239:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184214912 00000100:00100000:3.0:1788581380.961242:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184214912 00000100:00100000:1.0:1788581380.961587:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215040 00000100:00100000:1.0:1788581380.961592:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215040 00000100:00100000:1.0:1788581380.961617:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788581380.961627:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184214784:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788581380.961662:0:6494:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788581380.961724:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184214784:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 96us (1542us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581380.961732:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788581380.961749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788581380.961754:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184214912:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788581380.961760:0:6494:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788581380.961780:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184214912:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 25us (1040us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581380.961785:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788581380.961808:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788581380.961812:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184215040:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788581380.961819:0:6494:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788581380.961837:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184215040:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 24us (730us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581380.961843:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788581380.961874:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581380.961892:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581380.961896:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184214912:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788581380.961905:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581380.961909:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581380.961912:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184215040:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788581380.961919:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581380.961922:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581380.961925:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184214784:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788581381.825828:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788581382.210794:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d431a8120 - data ffff995e6b571ca8/ffff995d42fa0800 00000020:01000000:1.0:1788581382.211033:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e505f83c0 - data ffff995e6b4b4ca8/ffff995e7a6c6000 00000001:00000004:1.0:1788581382.219850:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788581382.316148:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788581382.316157:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788581382.316172:0:15071:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff995d43815500 x1875463184212992/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788581390 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581382.316207:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788581382.318530:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788581382.318539:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788581382.318576:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581382.318579:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788581382.326445:0:8904:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788581382.326459:0:8904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788581382.326490:0:8904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788581382.327317:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788581382.327326:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788581382.327351:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581382.327354:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788581382.329560:0:9952:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788581382.329572:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788581382.329591:0:9952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788581382.333342:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f6cb 00000020:00000080:3.0:1788581382.333362:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e80800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581382.334631:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e80800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788581382.341800:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f6e0 00000020:00000080:3.0:1788581382.341833:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e80000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788581382.341897:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788581382.341904:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581382.341916:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788581382.341922:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff995e71eb3370) has no exports 00000004:01000000:3.0:1788581382.342222:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788581382.342237:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb16 00000020:00000080:3.0:1788581382.342243:0:15071:0:(genops.c:885:class_export_put()) final put ffff995d42c38000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.342551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e80000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788581382.342653:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788581382.342659:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581382.342672:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788581382.342676:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff995d42c03370) has no exports 00000020:00000080:3.0:1788581382.342685:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fb0f 00000020:00000080:3.0:1788581382.342690:0:15071:0:(genops.c:885:class_export_put()) final put ffff995d4328d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581382.342712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c38000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788581382.343198:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788581382.343214:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788581382.343220:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788581382.343227:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581382.343230:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581382.343626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4328d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788581382.343762:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581382.343779:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581382.343788:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f9d4 00000020:00000080:3.0:1788581382.343796:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e7a6d3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.343881:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d4328e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788581382.343889:0:36:0:(genops.c:885:class_export_put()) final put ffff995d4328b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.343892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4328b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788581382.343897:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581382.344452:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788581382.344475:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581382.344486:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788581382.344492:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff995e7fa03370) has no exports 00000020:00000080:3.0:1788581382.344501:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f9cd 00000020:00000080:3.0:1788581382.344506:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e6f940000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581382.344655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788581382.344913:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f940000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788581382.345752:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788581382.345759:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788581382.345764:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788581382.345773:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581382.345776:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581382.345982:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581382.346100:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788581382.346122:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788581382.346135:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f884 00000020:00000080:3.0:1788581382.346146:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e6fadc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.349395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f941000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788581382.349434:0:36:0:(genops.c:885:class_export_put()) final put ffff995e6f947800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.349440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f947800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788581382.349452:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581382.349929:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788581382.349940:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581382.349957:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788581382.349963:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff995e47870000) has no exports 00000020:00000080:3.0:1788581382.349974:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f87d 00000020:00000080:1.0:1788581382.350434:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fadc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788581382.350476:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e6f8a2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581382.351893:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f8a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788581382.352469:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788581382.352477:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581382.352482:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788581382.352493:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581382.352552:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.352568:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581382.352602:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.352606:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581382.352612:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e82800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581382.352616:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e82800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788581382.352628:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581382.352766:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f6e7 00000020:00000080:2.0:1788581382.352787:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e86000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788581382.352792:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788581382.352796:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581382.352801:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788581382.352805:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff995e71eb0000) has no exports 00000020:00000080:2.0:1788581382.352829:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.352832:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788581382.352838:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f6ee 00000020:00000080:2.0:1788581382.352842:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e85800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788581382.352852:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4eb3a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788581382.352856:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3a800 3 00000020:01000004:2.0:1788581382.352859:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e4eb3a800 from lustre-MDT0000 00000020:00000080:2.0:1788581382.352894:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.352898:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788581382.352901:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e84800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788581382.352903:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e84800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788581382.352913:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788581382.352944:0:15071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788581382.352948:0:15071:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788581382.352951:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788581382.352954:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581382.352956:0:15071:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581382.352965:0:15071:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff995e4f108800 a41bfcf2-194f-415a-ba31-00ecb4f1e60f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581382.352970:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff995e7557b370) has exports, disconnecting them 00000020:00080000:2.0:1788581382.352975:0:15071:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff995e4f108800), last request at 1788581145 00000020:00000080:2.0:1788581382.353068:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f68c 00000020:00010000:2.0:1788581382.353075:0:15071:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995e4f108800: total 2 00000100:00080000:2.0:1788581382.353081:0:15071:0:(import.c:65:import_set_state_nolock()) ffff995e4f10f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788581382.353095:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e4f108800): rc 0 00000020:00080000:2.0:1788581382.353101:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff995e7557b370) has no exports 00000020:00010000:1.0:1788581382.353214:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995e4f108800: total 2 00010000:00010000:1.0:1788581382.353290:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995e4f108800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788581382.353339:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b2faad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2faa6 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353363:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c2e00/0x50f0cc74b7b2fe3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe34 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353376:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273400/0x50f0cc74b7b2fba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fba2 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353386:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273600/0x50f0cc74b7b2fc0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fc04 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353413:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272e00/0x50f0cc74b7b2fb9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fb94 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353424:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b2fbc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbbe expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353433:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273000/0x50f0cc74b7b2fbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbb0 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353444:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6be00/0x50f0cc74b7b2fe2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe26 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353456:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b2fbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbcc expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353465:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c2000/0x50f0cc74b7b2f788 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2f781 expref: 5 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353476:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e40031a00/0x50f0cc74b7b2fbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fbda expref: 4 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353489:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e429c3200/0x50f0cc74b7b2f796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2f78f expref: 3 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353503:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b2fe1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b2fe18 expref: 2 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581382.353513:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995e4f108800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788581382.353530:0:6481:0:(genops.c:885:class_export_put()) final put ffff995e4f108800/a41bfcf2-194f-415a-ba31-00ecb4f1e60f 00010000:00010000:1.0:1788581382.353537:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581382.353545:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581382.353547:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788581382.353560:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e6f8a7000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788581382.353568:0:36:0:(genops.c:885:class_export_put()) final put ffff995e6f8a1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581382.353570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f8a1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788581382.353576:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581382.353620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e86000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788581382.353625:0:36:0:(genops.c:885:class_export_put()) final put ffff995e71e85000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788581382.353627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e85000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788581382.353630:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788581382.353653:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e85800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788581382.353657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f108800/a41bfcf2-194f-415a-ba31-00ecb4f1e60f for MGS 00000020:00000080:1.0:1788581382.353682:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f10f800 for MGS 00000100:00100000:1.0:1788581382.356425:0:6486:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff995e6bc05400:6486] 0 exiting: rc = 1 00000100:00100000:1.0:1788581382.358541:0:6487:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff995e75563600:6487] 1 exiting: rc = 0 00000100:00100000:1.0:1788581382.359831:0:6488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff995e42e00000:6488] 2 exiting: rc = 0 00000100:00100000:2.0:1788581382.360310:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360323:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360348:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360355:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360363:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360372:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360380:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360387:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360393:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360402:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360410:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360418:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360424:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360432:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360439:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360446:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360453:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360460:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360466:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360473:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360479:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360487:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360494:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360501:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360508:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360514:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360520:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360526:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360533:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360539:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360545:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360552:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360558:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360564:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360572:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360579:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360585:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360600:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360607:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360614:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360620:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360627:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360636:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360642:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360649:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360655:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360662:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360668:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360674:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360681:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360688:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360694:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360701:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360707:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360713:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360719:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360728:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360734:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360739:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360745:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360752:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360758:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360764:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581382.360770:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788581382.362616:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d431a8900 - data ffff995e6b68f5e8/ffff995d42fa3c00 00000020:01000000:2.0:1788581382.362786:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e717a3a20 - data ffff995e6b530bd0/ffff995e4f2c2000 00000020:00000080:2.0:1788581382.370196:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f670 00000020:00000080:2.0:1788581382.370484:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e42f10800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788581382.370530:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e42f10800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788581382.370560:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4eb3a800 from MGS, refs=2 00000020:01000004:2.0:1788581382.370564:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3a800 2 00000020:01000004:2.0:1788581382.370595:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e4eb3a800 from MGS 00000020:00000080:2.0:1788581382.370632:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.370645:0:15071:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788581382.370649:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e42f12000/MGS 00000020:00000080:2.0:1788581382.370652:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e42f12000/MGS for MGS 00000020:01000000:2.0:1788581382.370662:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788581382.370788:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788581382.370794:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581382.370802:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581382.370817:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff995e71e83800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581382.370824:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff995e71eb19b8) has exports, disconnecting them 00000020:00080000:2.0:1788581382.370831:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff995e71e83800), last request at 1788581145 00000020:00000080:2.0:1788581382.370838:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f73b 00000020:00080000:2.0:1788581382.370852:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e71e83800): rc 0 00000020:00000080:2.0:1788581382.370858:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e83800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788581382.370907:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e83800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788581382.453236:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788581382.453249:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581382.453289:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581382.453300:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581382.453437:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f10e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788581382.453564:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581382.453577:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788581382.453584:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e71e84000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788581382.453590:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e84000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788581382.453607:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788581382.453856:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3a800 1 00000020:00000080:2.0:1788581382.453876:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f662 00000020:00000080:2.0:1788581382.453885:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e42f14000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788581382.453962:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788581382.453968:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581382.453991:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788581382.453998:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff995e47873370) has no exports 00000020:00000080:1.0:1788581382.457484:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff995e42f14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788581382.708471:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581382.708488:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788581382.708495:0:15071:0:(genops.c:885:class_export_put()) final put ffff995e4eb3d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788581382.708501:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4eb3d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788581382.708514:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788581382.712584:0:15071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e4eb38800 00000020:02000400:3.0:1788581382.712904:0:15071:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788581382.849436:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581383.874009:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581384.003339:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581384.003364:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184215168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581384.003437:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581384.005702:0:10323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215168 00000100:00100000:0.0:1788581384.005717:0:10323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215168 00000100:00100000:0.0:1788581384.005805:0:10323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788581384.005815:0:10323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184215168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581384.005868:0:10323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788581384.005951:0:10323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184215168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581384.005959:0:10323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788581384.007447:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581384.008230:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184215168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788581384.899723:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581385.922791:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581386.050557:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184215296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581386.050678:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.050783:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215296 00000100:00100000:3.0:1788581386.050804:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215296 00000100:00100000:3.0:1788581386.050885:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581386.050896:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184215296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581386.050932:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788581386.050985:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184215296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581386.050993:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581386.051068:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184215296:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788581386.053481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581386.053489:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788581386.053494:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581386.053503:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 367 00000100:00080000:2.0:1788581386.053510:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581386.053517:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e81d97000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581386.053547:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44071880 x1875463184215552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581386.053568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581386.053572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788581386.053574:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581386.053577:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 367 00000100:00080000:2.0:1788581386.053580:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581386.053583:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995e81fc2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581386.053598:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44071500 x1875463184215680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581386.053607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581386.053611:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788581386.053612:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581386.053616:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 367 00000100:00080000:2.0:1788581386.053619:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581386.053623:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a6d6000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581386.053635:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44071c00 x1875463184215808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581386.053679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581386.053683:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788581386.053685:0:36:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581386.053689:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 367 00000100:00080000:2.0:1788581386.053692:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581386.053696:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995d42e9a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581386.053709:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43bb7100 x1875463184216192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581386.053757:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184216064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581386.053786:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184215424:0@lo:400:kworker.0 00000400:00000100:3.0:1788581386.053830:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184215424 offset 0 length 224: 4 00000100:00100000:2.0:1788581386.053858:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581386.053904:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581386.053905:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581386.053914:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184216320:0@lo:400:kworker.0 00000100:00100000:3.0:1788581386.053917:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184215936:0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.053959:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581386.053970:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581386.054017:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184215552:0@lo:38:kworker.0 00000100:00100000:2.0:1788581386.054762:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581386.054806:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184215680:0@lo:38:kworker.0 00000100:00100000:2.0:1788581386.054836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581386.054869:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184215808:0@lo:38:kworker.0 00000100:00100000:2.0:1788581386.054892:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581386.054911:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184216192:0@lo:38:kworker.0 00000100:00100000:2.0:1788581386.054932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581386.054991:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216064 00000100:00100000:2.0:1788581386.055002:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216064 00000100:00080000:3.0:1788581386.055585:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581386.055649:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215552 00000100:00100000:3.0:1788581386.055655:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215552 00000100:00100000:3.0:1788581386.055703:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788581386.055713:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184215552:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788581386.055740:0:7450:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581386.056175:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581386.056196:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184216064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.056435:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184216064:12345-0@lo:400:kworker.0 Request processed in 242us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581386.056445:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581386.056486:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216320 00000100:00100000:2.0:1788581386.056492:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216320 00000100:00100000:2.0:1788581386.056534:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215680 00000100:00100000:2.0:1788581386.056537:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215680 00000100:00100000:2.0:1788581386.056548:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215808 00000100:00100000:2.0:1788581386.056551:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215808 00000100:00100000:2.0:1788581386.056560:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216192 00000100:00100000:2.0:1788581386.056562:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216192 00000100:00100000:2.0:1788581386.056573:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788581386.056580:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184216320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.056618:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184216320:12345-0@lo:400:kworker.0 Request processed in 39us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581386.056625:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788581386.056639:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788581386.056644:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184215680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581386.056660:0:11562:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581386.056689:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184215680:12345-0@lo:38:kworker.0 Request processed in 44us (1852us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581386.056696:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788581386.056707:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788581386.056711:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184215808:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581386.056720:0:11562:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581386.056743:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184215808:12345-0@lo:38:kworker.0 Request processed in 31us (1850us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581386.056757:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788581386.056783:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788581386.056788:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184216192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581386.056798:0:11562:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581386.056823:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875463184216192:12345-0@lo:38:kworker.0 Request processed in 34us (1891us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581386.056829:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1788581386.056906:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff995d43bb5500 x1875463184216320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581386.056925:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184216320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.056945:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184216064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.057020:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.057132:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184215552:12345-0@lo:38:kworker.0 Request processed in 1417us (2371us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581386.057154:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1788581386.057183:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581386.057212:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581386.057218:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581386.057222:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184215552:0@lo:38:kworker.0 00000100:00080000:3.0:1788581386.057245:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581386.057250:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581386.057277:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184215680:0@lo:38:kworker.0 00000100:00080000:3.0:1788581386.057289:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581386.057293:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581386.057296:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184215808:0@lo:38:kworker.0 00000100:00080000:3.0:1788581386.057306:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581386.057309:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581386.057312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184216192:0@lo:38:kworker.0 00000100:00100000:3.0:1788581386.057370:0:11562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184215936 00000100:00100000:3.0:1788581386.057375:0:11562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184215936 00000100:00100000:3.0:1788581386.057419:0:11562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788581386.057426:0:11562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184215936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581386.057465:0:11562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184215936:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581386.057472:0:11562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:3.0:1788581386.057488:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788581386.057990:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff995d44072300 x1875463184215936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581386.058005:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184215936:0@lo:400:kworker.0 00000020:01000004:2.0:1788581386.919206:0:15274:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581386.944482:0:15274:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788581386.944542:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.944557:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.944563:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.944664:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.944687:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581386.944702:0:15274:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788581386.944736:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581386.944741:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581386.944748:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581386.944756:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995e81fc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788581386.944761:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581386.944763:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581386.944767:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788581386.945693:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581386.945706:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581386.945718:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581386.945722:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581386.945733:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581386.945741:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581386.945748:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788581386.945750:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788581386.945753:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788581386.945807:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581386.945814:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581386.945862:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581386.945869:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b2fbcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbd3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581386.945883:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581386.945884:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581386.945886:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581386.945973:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.946045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581386.946152:0:7444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216448 00000100:00100000:0.0:1788581386.946159:0:7444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216448 00000100:00100000:0.0:1788581386.946210:0:7444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581386.946218:0:7444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3618:x1875463184216448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788581386.946223:0:7444:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581386 with bad export cookie 5832386319115024012 00010000:00010000:2.0:1788581386.947861:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947875:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947881:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947889:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947912:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581386.947918:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947941:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947947:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947953:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947964:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581386.947970:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947976:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947983:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.947988:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.948002:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788581386.948007:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.948013:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.948029:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.948035:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581386.948042:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788581386.948045:0:15274:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788581386.948072:0:15274:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788581386.948075:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788581386.948080:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581386.948085:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788581386.948091:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff995e7fa4c800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581386.948096:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff995e7a785000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581386.948100:0:15274:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff995e7a693370) has exports, disconnecting them 00000020:00080000:2.0:1788581386.948111:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff995e7fa4c800), last request at 1788581386 00000020:00000080:2.0:1788581386.948117:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fa6e 00000100:00080000:2.0:1788581386.948133:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995e7fa4f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788581386.948181:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7fa4c800): rc 0 00000020:00000080:2.0:1788581386.948184:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e7fa4c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788581386.948193:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff995e7a785000), last request at 1788581386 00000020:00000080:2.0:1788581386.948197:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f948 00000100:00080000:2.0:1788581386.948202:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995e7a780800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788581386.948207:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7a785000): rc 0 00000020:00000080:2.0:1788581386.948209:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e7a785000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788581386.948215:0:15274:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffabf141983ae0 00000100:00080000:2.0:1788581386.948232:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581386.948246:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788581386.948479:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788581386.948486:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948493:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581386.948497:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948516:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581386.948527:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581386.948533:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581386.948535:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788581386.948537:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788581386.948589:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948595:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581386.948616:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948622:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43272600/0x50f0cc74b7b2fbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fbe1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948637:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788581386.948640:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948648:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581386.948651:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948657:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581386.948678:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581386.948683:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581386.948685:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788581386.948686:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788581386.948705:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948712:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581386.948727:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948734:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031600/0x50f0cc74b7b2faa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2faad expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948746:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581386.948749:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948755:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581386.948758:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948765:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581386.948771:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581386.948787:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788581386.948789:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581386.948791:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788581386.948805:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948811:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581386.948817:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948824:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b2fe34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2fe3b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948833:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581386.948836:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948852:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c3400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581386.948855:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948862:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581386.948868:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581386.948873:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581386.948875:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788581386.948877:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788581386.948897:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948909:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581386.948915:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948925:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e429c3400/0x50f0cc74b7b2f78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b2f796 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581386.948936:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581386.948938:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581386.948940:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581386.948959:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.949027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.949059:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581386.949065:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.949086:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.949111:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184216704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.949131:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.949148:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581386.949153:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184216832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.949170:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581386.949193:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216960 00000100:00100000:3.0:1788581386.949200:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216960 00000100:00100000:3.0:1788581386.949220:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216576 00000100:00100000:3.0:1788581386.949223:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216576 00000100:00100000:3.0:1788581386.949231:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216704 00000100:00100000:3.0:1788581386.949233:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216704 00000100:00100000:3.0:1788581386.949240:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184216832 00000100:00100000:3.0:1788581386.949248:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184216832 00000100:00100000:3.0:1788581386.949284:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581386.949291:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47ed1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875463184216960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788581386.949296:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581386 with bad export cookie 5832386319115024012 00000100:00100000:3.0:1788581386.949338:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47ed1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875463184216960:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (311us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581386.949345:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581386.949360:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581386.949363:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875463184216576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788581386.949368:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581386 with bad export cookie 5832386319115024012 00000100:00100000:3.0:1788581386.949392:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875463184216576:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (305us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581386.949398:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581386.949409:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581386.949413:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875463184216704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788581386.949417:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581386 with bad export cookie 5832386319115024012 00000100:00100000:3.0:1788581386.949443:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875463184216704:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (311us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581386.949450:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581386.949460:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581386.949464:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875463184216832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788581386.949468:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581386 with bad export cookie 5832386319115024012 00000100:00100000:3.0:1788581386.949490:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875463184216832:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (319us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581386.949495:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788581386.949520:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788581386.949528:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788581386.949532:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788581386.949610:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581386.950380:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581386.950386:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995e81d97000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788581386.950440:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:1.0:1788581386.952869:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788581386.952935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a785000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788581386.952958:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa4f000 for lustre-MDT0001 00000020:00000080:1.0:1788581386.952980:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a780800 for lustre-MDT0001 00010000:00010000:1.0:1788581386.953096:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581386.964889:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581386.964897:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788581386.964917:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788581386.964987:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788581386.965023:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788581386.965043:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581386.965045:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788581386.965054:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788581386.965110:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788581386.965119:0:15274:0:(import.c:65:import_set_state_nolock()) ffff995d41e5e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788581386.965148:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff995e7a693370) has no exports 00000100:00100000:0.0:1788581386.971706:0:7444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3618:x1875463184216448:12345-0@lo:103:ldlm_bl.0 Request processed in 25479us (25653us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788581386.971719:0:7444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788581386.989180:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.103@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788581386.989186:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788581386.989196:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d44070e00 x1875463184215424/t0(0) o400->MGC192.168.203.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581386.989211:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a1880 x1875463184216448/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581386.989220:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43815c00 x1875463184216960/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581386.989229:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43817100 x1875463184216576/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581386.989238:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43816d80 x1875463184216704/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581386.989246:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43814380 x1875463184216832/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581402 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788581386.989313:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788581386.989326:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788581386.989327:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788581386.989459:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff995e45134800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1788581386.989480:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581386.989486:0:3618:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:3.0:1788581386.989495:0:3618:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e45134800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581386.989501:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184216704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.989512:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184217088:0@lo:9:umount.0 00000100:00100000:2.0:1788581386.989527:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3620:1875463184216832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581386.989578:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43bb7100 x1875463184217344/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581386.989597:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581386.989618:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581386.989625:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184215424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581386.989642:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3618:1875463184216576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581386.989651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581386.989768:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184217088 00000100:00100000:0.0:1788581386.989776:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184217088 00000100:00100000:0.0:1788581386.989824:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581386.989833:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875463184217088:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788581386.989868:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f995 00000100:00080000:0.0:1788581386.989878:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995e4f27b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788581386.989918:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184217216:0@lo:9:umount.0 00000100:00100000:3.0:1788581386.989944:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581386.991030:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788581386.991066:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788581386.991268:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3617:x1875463184217088:12345-0@lo:9:umount.0 Request processed in 1417us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581386.991278:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581386.991391:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184217344:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788581386.991431:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184217344 offset 0 length 520: 4 00000100:00080000:3.0:1788581386.991467:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788581386.991490:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788581386.991493:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581386.991496:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184217088:0@lo:9:umount.0 00000100:00100000:0.0:1788581386.995465:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184217216 00000100:00100000:0.0:1788581386.995480:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184217216 00000100:00100000:0.0:1788581386.995553:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581386.995563:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875463184217216:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788581386.996407:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fad7 00000100:00080000:0.0:1788581386.996420:0:8410:0:(import.c:65:import_set_state_nolock()) ffff995d42c3f800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788581386.996461:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788581386.996474:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788581386.997020:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3617:x1875463184217216:12345-0@lo:9:umount.0 Request processed in 1453us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581386.997033:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1788581386.997337:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581386.997718:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d41e5e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788581386.997741:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788581386.997744:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581386.997749:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184217216:0@lo:9:umount.0 00000020:00080000:0.0:1788581387.003934:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff995e7a693370) has no exports 00000020:01000000:2.0:1788581387.078959:0:15274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d42df6120 - data ffff995e6b6f8438/ffff995d42fa0000 00000020:01000000:2.0:1788581387.079121:0:15274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e505f8e40 - data ffff995e6b4a0bd0/ffff995e81eff400 00000001:00000004:3.0:1788581387.093676:0:15274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788581387.152560:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581387.152569:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788581387.152577:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788581387.155196:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788581387.155203:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788581387.155225:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788581387.155228:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788581387.155768:0:8900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788581387.155774:0:8900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788581387.155783:0:8900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788581387.156523:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788581387.156528:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788581387.156547:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788581387.156549:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788581387.156907:0:9944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788581387.156911:0:9944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788581387.156932:0:9944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788581387.164108:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7b2 00000020:00000080:2.0:1788581387.164121:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0e8000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581387.169978:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7c7 00000020:00000080:2.0:1788581387.169993:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0ee800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581387.170604:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0e8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788581387.172617:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788581387.172632:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581387.172642:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788581387.172648:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff995e7a6919b8) has no exports 00000004:01000000:2.0:1788581387.172858:0:15274:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788581387.172868:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fad0 00000020:00000080:2.0:1788581387.172875:0:15274:0:(genops.c:885:class_export_put()) final put ffff995d42e9b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581387.180779:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0ee800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788581387.181584:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788581387.181654:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42e9b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788581387.181924:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581387.181939:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788581387.181945:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff995d42c019b8) has no exports 00000020:00000080:0.0:1788581387.181957:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fac9 00000020:00000080:0.0:1788581387.181966:0:15274:0:(genops.c:885:class_export_put()) final put ffff995d42e99000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788581387.182990:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42e99000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788581387.183888:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788581387.183895:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788581387.183900:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788581387.183908:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581387.183910:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788581387.184443:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581387.184460:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581387.184468:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f98e 00000020:00000080:0.0:1788581387.184477:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f8a6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581387.188580:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d41e5e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788581387.188602:0:15242:0:(genops.c:885:class_export_put()) final put ffff995d42e99800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581387.188606:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42e99800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788581387.188616:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788581387.195725:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788581387.195746:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581387.195762:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788581387.195768:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff995e7a7399b8) has no exports 00000020:00000080:0.0:1788581387.195781:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f987 00000020:00000080:0.0:1788581387.195792:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e4f27d000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581387.196201:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f8a6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1788581387.196982:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788581387.196987:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788581387.196991:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788581387.197009:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581387.197011:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581387.197048:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f27d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788581387.197137:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581387.197158:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788581387.197174:0:15274:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788581387.197183:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7ea 00000020:00000080:0.0:1788581387.197190:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e81d91000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788581387.203515:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788581387.203530:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581387.203544:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788581387.203549:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff995e81dc8000) has no exports 00000020:00000080:0.0:1788581387.203559:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7e3 00000020:00000080:0.0:1788581387.203569:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e81d92000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581387.204726:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f27e800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788581387.204738:0:15242:0:(genops.c:885:class_export_put()) final put ffff995e6f8a5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581387.204741:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f8a5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788581387.204747:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581387.204828:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81d91000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788581387.204833:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81d92000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788581387.205474:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788581387.205479:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581387.205483:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788581387.205489:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581387.205510:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e81d97000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788581387.205545:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581387.205566:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581387.205569:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e81d95800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581387.205571:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81d95800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788581387.205576:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581387.205717:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581387.205721:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581387.205724:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e7a786800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581387.205727:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a786800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788581387.205731:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581387.205835:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7ce 00000020:00000080:2.0:1788581387.205852:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0ed000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788581387.205862:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788581387.205869:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0ed000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788581387.205878:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581387.205883:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581387.205886:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff995e7a694d28) has no exports 00000020:00000080:2.0:1788581387.205903:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581387.205906:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788581387.205909:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0ea000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788581387.205910:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0ea000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788581387.205913:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788581387.206074:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f7d5 00000020:00000080:2.0:1788581387.206079:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0ef800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581387.206091:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0ef800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:2.0:1788581387.206101:0:15274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4f1e6000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788581387.206105:0:15274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4f1e6000 2 00000020:01000004:2.0:1788581387.206108:0:15274:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e4f1e6000 from lustre-MDT0001 00000020:00000080:2.0:1788581387.206129:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581387.206133:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788581387.206135:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e6f0ee000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788581387.206137:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f0ee000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788581387.206163:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788581387.206191:0:15274:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788581387.206196:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788581387.206198:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581387.206202:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581387.206209:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff995e81fc3000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581387.206214:0:15274:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff995e81dc99b8) has exports, disconnecting them 00000020:00080000:2.0:1788581387.206218:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff995e81fc3000), last request at 1788581164 00000020:00000080:2.0:1788581387.206550:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f829 00000020:00080000:2.0:1788581387.206560:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e81fc3000): rc 0 00000020:00000080:2.0:1788581387.206564:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e81fc3000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788581387.206594:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81fc3000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788581387.209473:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788581387.209483:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581387.209489:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788581387.209496:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581387.209679:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581387.209689:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788581387.209697:0:15274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4f1e6000 1 00000020:00000080:3.0:1788581387.209704:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f765 00000020:00000080:3.0:1788581387.209713:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e71e39800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788581387.209719:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788581387.209724:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581387.209740:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788581387.209744:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff995e7a690000) has no exports 00000020:00000080:3.0:1788581387.237489:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e81fc2800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788581387.237508:0:15242:0:(genops.c:885:class_export_put()) final put ffff995e81fc3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788581387.237512:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e81fc3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788581387.237524:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788581387.237673:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e71e39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788581387.332314:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581387.332329:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788581387.332335:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e7a785800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788581387.332341:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a785800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788581387.332355:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788581387.332480:0:15274:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e71e82000 00000020:01000000:3.0:1788581387.332501:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788581387.332506:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581387.332511:0:15274:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788581387.332515:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff995e75578000) has no exports 00000100:00100000:3.0:1788581387.332632:0:11562:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff995d42e78c00:11562] 4 exiting: rc = 0 00000100:00100000:3.0:1788581387.332767:0:6493:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff995e53af3800:6493] 0 exiting: rc = 1 00000100:00100000:2.0:1788581387.333385:0:6495:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff995e4ea6fa00:6495] 2 exiting: rc = 0 00000100:00100000:0.0:1788581387.333618:0:9504:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff995d4216c400:9504] 3 exiting: rc = 0 00000100:00100000:1.0:1788581387.334732:0:6494:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff995e75632200:6494] 1 exiting: rc = 0 00000100:00100000:3.0:1788581387.334786:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334798:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334805:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334812:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334819:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334826:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334833:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334851:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334858:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334864:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334870:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334876:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334881:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334910:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334919:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334925:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334932:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334938:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334944:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334950:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334956:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334962:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334969:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334976:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334982:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334988:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.334995:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335002:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335007:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335013:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335020:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335026:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335032:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335037:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335043:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335049:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335055:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335060:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335066:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335071:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335077:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335082:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335087:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335092:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335097:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335102:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335107:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335113:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335128:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335133:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335138:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335142:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335147:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335152:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335158:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335163:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335168:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335174:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335179:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335184:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335190:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335195:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335203:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.335208:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.339971:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff995e4ea6fc00:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1788581387.340081:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff995e4ea6ec00:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1788581387.344697:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344711:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344717:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344724:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344731:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344736:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344742:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344748:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344754:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344760:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344766:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344774:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344781:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344787:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344792:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344798:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344802:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344824:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344830:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344846:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344852:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344857:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344862:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344867:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344872:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344877:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344882:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344887:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344892:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344897:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344903:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344908:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344914:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344920:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344926:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344931:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344937:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344942:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344947:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344953:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344958:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344963:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344969:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344974:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344979:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344985:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.344991:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346034:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346042:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346047:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346052:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346057:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346077:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346081:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346087:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346093:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346098:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346102:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346108:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346113:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346118:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346123:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346128:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.346133:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581387.347737:0:7450:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff995e6f87e800:7450] 2 exiting: rc = 0 00000100:00100000:0.0:1788581387.347916:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff995e4ea6f000:6499] 1 exiting: rc = 0 00000100:00100000:0.0:1788581387.348093:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff995e4ea6ea00:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1788581387.348998:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349025:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349045:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349053:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349061:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349068:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349076:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349084:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349092:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349100:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349108:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349115:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349123:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349130:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349166:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349174:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349198:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349206:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349214:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349220:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349226:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349234:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349239:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349244:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349250:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349565:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349587:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349594:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349600:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349607:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349614:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349619:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349626:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349633:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349638:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349644:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349650:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349655:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349678:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349685:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349692:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349697:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349704:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349710:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349716:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349722:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349729:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349734:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349741:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349749:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349770:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349784:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349792:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349799:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349805:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349811:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349817:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349823:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349830:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349846:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349854:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349860:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349867:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.349881:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.369567:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff995e4ea6e800:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1788581387.372761:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff995e75630e00:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1788581387.373001:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373010:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373015:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373020:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373026:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373032:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373037:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373043:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373048:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373053:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373058:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373063:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373069:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373074:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373080:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373085:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373090:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373096:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373102:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373107:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373113:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373119:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373124:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373157:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373163:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373168:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373173:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373178:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373184:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373189:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373194:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373199:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373205:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373212:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373218:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373223:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373229:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373233:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373239:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373244:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373248:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373287:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373293:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373298:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373304:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373309:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.373325:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374827:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374849:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374854:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374860:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374865:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374869:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374874:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374879:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374884:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374889:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374893:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374913:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374918:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374924:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374930:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374935:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.374943:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581387.375711:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff995e75630200:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1788581387.375897:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff995e75630c00:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1788581387.375924:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375930:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375935:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375940:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375945:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375950:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375955:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375961:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375966:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375971:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375977:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375982:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375987:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375993:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.375999:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376004:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376010:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376015:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376021:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376025:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376030:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376036:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376041:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376046:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376051:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376055:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376060:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376065:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376070:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376084:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376090:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376095:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376102:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376120:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376127:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376132:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376138:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376150:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376158:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376163:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376168:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376173:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376178:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376182:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376187:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376192:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376197:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376202:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376208:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376213:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376217:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376222:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376227:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376232:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376237:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376241:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376246:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376574:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376582:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376587:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376592:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376597:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376603:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.376607:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581387.378744:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff995e75630800:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1788581387.381884:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff995e75631200:6505] 1 exiting: rc = 0 00000100:00100000:1.0:1788581387.382074:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382083:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382089:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382095:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382100:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382105:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382111:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382115:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382120:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382126:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382132:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382137:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382142:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382148:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382153:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382158:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382163:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382169:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382174:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382179:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382184:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382188:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382194:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382199:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382204:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382208:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382214:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382219:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382224:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382229:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382234:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382238:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382243:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382247:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382285:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382307:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382321:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382326:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382438:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382444:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382448:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382453:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382459:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382463:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382468:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382474:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382479:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382484:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382490:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382495:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382499:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382504:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382509:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382514:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382518:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382523:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382528:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382534:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382539:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382543:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382548:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382553:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382558:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.382563:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.383116:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff995e66079000:6508] 2 exiting: rc = 0 00000100:00100000:3.0:1788581387.384000:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff995e4e93a600:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1788581387.384235:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff995e4e93aa00:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1788581387.384612:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384620:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384625:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384631:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384638:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384666:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384674:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384680:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384685:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384690:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384697:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384702:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384707:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384712:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384717:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384723:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384728:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384734:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384740:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384746:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384751:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384757:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384776:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384783:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384788:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384795:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384801:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384807:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384813:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384819:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384824:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384830:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384848:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384856:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384862:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384868:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384874:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384879:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384885:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384891:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384904:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384910:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384917:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384924:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384930:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384937:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384959:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384966:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384971:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384977:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384983:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384989:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384994:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.384999:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385005:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385012:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385017:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385022:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385028:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385034:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385039:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385045:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385051:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581387.385057:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788581387.395754:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581387.395770:0:15274:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788581387.395776:0:15274:0:(genops.c:885:class_export_put()) final put ffff995e47ae4000/MDS_uuid 00000020:00000080:1.0:1788581387.395782:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff995e47ae4000/MDS_uuid for MDS 00000020:01000000:1.0:1788581387.395789:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788581387.395982:0:15274:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788581388.033470:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581389.066291:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581390.081542:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581391.105417:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581391.169440:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581391.169451:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581391.169454:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581391.169458:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581391.169463:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581391.169473:0:15242:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 372 00000100:00080000:0.0:1788581391.169479:0:15242:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788581391.169488:0:15242:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a6d6000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581391.169535:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a0000 x1875463184217472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581391.169624:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581391.169628:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581391.169629:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581391.169633:0:15242:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 372 00000100:00080000:0.0:1788581391.169636:0:15242:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788581391.169640:0:15242:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995d42e9a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581391.169653:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a1c00 x1875463184217728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581391.169690:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581391.169706:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184217600:0@lo:400:kworker.0 00000400:00000100:0.0:1788581391.169769:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184217600 offset 0 length 224: 4 00000100:00100000:3.0:1788581391.169898:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184217472:0@lo:38:kworker.0 00000400:00000100:3.0:1788581391.169926:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184217472 offset 0 length 520: 4 00000100:00100000:3.0:1788581391.169944:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184217728:0@lo:38:kworker.0 00000400:00000100:3.0:1788581391.169960:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184217728 offset 0 length 520: 4 00000100:00100000:3.0:1788581391.169987:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581391.169994:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184217856:0@lo:400:kworker.0 00000400:00000100:3.0:1788581391.170012:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184217856 offset 0 length 224: 4 00000020:01000004:0.0:1788581391.776682:0:15475:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788581391.796867:0:15475:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788581391.796925:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581391.796942:0:15475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581391.796949:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581391.796957:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581391.797016:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788581391.797022:0:15475:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788581391.797061:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581391.797071:0:15475:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a0000 x1875463184217472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581391.797093:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788581391.797100:0:15475:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788581391.797106:0:15475:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788581391.797111:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581391.797115:0:15475:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a0000 x1875463184217472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581411 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581391.797121:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788581391.797125:0:15475:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:3.0:1788581391.797188:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184217472:0@lo:38:kworker.0 00000100:00080000:0.0:1788581391.798950:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788581391.798964:0:15475:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a1180 x1875463184217600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581407 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581391.798995:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788581391.799002:0:15475:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788581391.799026:0:15475:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788581391.799099:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184217984:0@lo:39:umount.0 00000400:00000100:3.0:1788581391.799153:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184217984 offset 0 length 224: 4 00000100:00100000:1.0:1788581391.799326:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184217600:0@lo:400:kworker.0 00010000:00010000:2.0:1788581391.799584:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581391.799593:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581391.799602:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40030a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581391.799606:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581391.799617:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581391.799624:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581391.799630:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581391.799644:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788581391.799646:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788581391.799662:0:6482:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:2.0:1788581391.799665:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581391.799672:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40030a00/0x50f0cc74b7b2fbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fbb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581391.799685:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581391.799687:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581391.799689:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581392.129743:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581392.193608:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581392.193619:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581392.193622:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581392.193626:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581392.193782:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581392.193815:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184218112:0@lo:400:kworker.0 00000400:00000100:2.0:1788581392.193875:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184218112 offset 0 length 224: 4 00000001:00100000:0.0:1788581392.707818:0:9486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788581392.707826:0:9486:0:(genops.c:885:class_export_put()) final put ffff995d42c39800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788581392.709595:0:8400:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581392.709604:0:8400:0:(genops.c:885:class_export_put()) final put ffff995e4f27a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581392.709659:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c39800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788581392.709724:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c3f800 for lustre-OST0001 00000020:00000080:0.0:1788581392.711427:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f27a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788581392.711499:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f27b000 for lustre-OST0000 00010000:00010000:3.0:1788581393.153482:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581394.177720:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581395.202700:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581396.225428:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581396.225440:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788581396.225443:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581396.225444:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581396.225458:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581396.225576:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581396.225598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184218240:0@lo:400:kworker.0 00000400:00000100:3.0:1788581396.225654:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184218240 offset 0 length 224: 4 00000100:00100000:3.0:1788581396.929648:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581386/real 1788581386] req@ffff995d43bb7100 x1875463184217344/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581396 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581396.929685:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43bb7100 x1875463184217344/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581396 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581396.929705:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581396.929730:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788581396.929734:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184217344:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788581396.929836:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581396.929857:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788581396.929860:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581396.929865:0:15242:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 373 00000100:00080000:0.0:1788581396.929869:0:15242:0:(import.c:589:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581396.929876:0:15242:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e45134800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581396.929906:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a0e00 x1875463184218368/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581396.929931:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581396.929935:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581396.930034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184218496:0@lo:400:kworker.0 00000400:00000100:2.0:1788581396.930083:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184218496 offset 0 length 224: 4 00000100:00100000:3.0:1788581396.930217:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184218368:0@lo:250:kworker.0 00000400:00000100:3.0:1788581396.930240:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184218368 offset 0 length 520: 4 00010000:00010000:2.0:1788581397.250199:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581398.275420:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581399.298293:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581400.321824:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581401.026127:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581391/real 1788581391] req@ffff995e7b2a2d80 x1875463184217984/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581401.026163:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e7b2a2d80 x1875463184217984/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581401.026206:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788581401.026334:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184217984:0@lo:39:umount.0 00000100:00080000:0.0:1788581401.034189:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788581401.034202:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788581401.034210:0:15475:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788581401.038019:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039320:0:15475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039330:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039336:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039358:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581401.039365:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039395:0:15475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039401:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039406:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581401.039427:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788581401.039432:0:15475:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788581401.039467:0:15475:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788581401.039472:0:15475:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788581401.039478:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581401.039484:0:15475:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581401.039489:0:15475:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff995d41c03370) has no exports 00000020:00080000:0.0:1788581401.039514:0:15475:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff995d41c03370) has no exports 00010000:00010000:3.0:1788581401.040323:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581401.040335:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040345:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581401.040349:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040359:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581401.040366:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581401.040372:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581401.040376:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788581401.040378:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788581401.040398:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:3.0:1788581401.040401:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040408:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b2fbbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fbc5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040425:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581401.040429:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040449:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581401.040452:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040459:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581401.040465:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581401.040470:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788581401.040473:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581401.040475:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788581401.040481:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:3.0:1788581401.040484:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040490:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0fe00/0x50f0cc74b7b2fe26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fe2d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581401.040500:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581401.040501:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581401.040503:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581401.041772:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788581401.056596:0:15475:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d42df6ea0 - data ffff995e6b6ca870/ffff995d42fa0400 00000020:01000000:2.0:1788581401.057539:0:15475:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e717a3de0 - data ffff995e6b6c95e8/ffff995e6fb99400 00100000:10000000:2.0:1788581401.065916:0:15475:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788581401.074716:0:15475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f902 00000020:00000080:3.0:1788581401.074730:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e6fade800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788581401.074760:0:15475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f8e1800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788581401.074763:0:15475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f8e1800 2 00000020:01000004:3.0:1788581401.074766:0:15475:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e6f8e1800 from lustre-OST0000 00000020:00000080:3.0:1788581401.074791:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581401.074811:0:15475:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788581401.074814:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e7a6d7000/lustre-OST0000_UUID 00000020:00000080:3.0:1788581401.074817:0:15475:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788581401.074824:0:15475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788581401.074879:0:15475:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788581401.074883:0:15475:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788581401.074886:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581401.074891:0:15475:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788581401.074897:0:15475:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff995e7a6d4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581401.074903:0:15475:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff995d41c04d28) has exports, disconnecting them 00000020:00080000:3.0:1788581401.074908:0:15475:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff995e7a6d4000), last request at 1788581180 00000020:00000080:3.0:1788581401.074912:0:15475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f92c 00000020:00080000:3.0:1788581401.074921:0:15475:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7a6d4000): rc 0 00000020:00000080:3.0:1788581401.074928:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e7a6d4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788581401.079190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fade800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788581401.079219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788581401.086202:0:15475:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788581401.086212:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581401.086216:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788581401.086224:0:15475:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581401.086382:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a6d6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788581401.087543:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581401.087559:0:15475:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788581401.087566:0:15475:0:(genops.c:885:class_export_put()) final put ffff995d41e5a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788581401.087571:0:15475:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e5a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788581401.087578:0:15475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788581401.087662:0:15475:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788581401.087666:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581401.087672:0:15475:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788581401.087679:0:15475:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff995e7a6d4800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581401.087685:0:15475:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff995d41c00000) has exports, disconnecting them 00000020:00080000:0.0:1788581401.087690:0:15475:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff995e7a6d4800), last request at 1788581180 00000020:00000080:0.0:1788581401.087694:0:15475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f941 00000020:00080000:0.0:1788581401.087715:0:15475:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7a6d4800): rc 0 00000020:00000080:0.0:1788581401.087720:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e7a6d4800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788581401.088293:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d4800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788581401.089359:0:15475:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788581401.089366:0:15475:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788581401.089371:0:15475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788581401.089378:0:15475:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581401.089402:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a6d0800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788581401.090399:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581401.090413:0:15475:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788581401.090418:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e7a6d3000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788581401.090422:0:15475:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d3000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788581401.090428:0:15475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788581401.090502:0:15475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f8e1800 1 00000020:00000080:1.0:1788581401.090508:0:15475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f8ca 00000020:00000080:1.0:1788581401.090514:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e6fadc000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788581401.090529:0:15475:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788581401.090544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fadc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788581401.090557:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581401.090562:0:15475:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788581401.090566:0:15475:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff995e755799b8) has no exports 00000020:00000080:1.0:1788581401.268178:0:15475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581401.268192:0:15475:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788581401.268198:0:15475:0:(genops.c:885:class_export_put()) final put ffff995e6f8e2000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788581401.268203:0:15475:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f8e2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788581401.268213:0:15475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788581401.268482:0:15475:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e6f8e5000 00000020:02000400:1.0:1788581401.268535:0:15475:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788581401.346613:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581402.369600:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581402.433388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788581402.433399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581402.433402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788581402.433405:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581402.433502:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184218624:0@lo:400:kworker.0 00000400:00000100:0.0:1788581402.433556:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184218624 offset 0 length 224: 4 00010000:00010000:1.0:1788581403.395209:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581404.417762:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581405.265843:0:15678:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581405.282438:0:15678:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788581405.282524:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581405.282538:0:15678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581405.282545:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581405.282552:0:15678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581405.282578:0:15678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581405.282583:0:15678:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788581405.282609:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581405.282622:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a1c00 x1875463184217728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.282645:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581405.282652:0:15678:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581405.282658:0:15678:0:(import.c:65:import_set_state_nolock()) ffff995d42e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788581405.282662:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581405.282666:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a1c00 x1875463184217728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581411 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.282672:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581405.282689:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788581405.282773:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184217728:0@lo:38:kworker.0 00000100:00080000:2.0:1788581405.283743:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581405.283753:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a3800 x1875463184217856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581407 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.283831:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a3100 x1875463184218112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581408 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.283916:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43bb7480 x1875463184218240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581412 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.283935:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e7b2a1f80 x1875463184218496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581412 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.283945:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43816a00 x1875463184218624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581405.283952:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788581405.283978:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184218496:0@lo:400:kworker.0 00000100:00100000:2.0:1788581405.283987:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184218240:0@lo:400:kworker.0 00000100:00080000:2.0:1788581405.284018:0:15678:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788581405.284039:0:15678:0:(import.c:65:import_set_state_nolock()) ffff995d42c3d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788581405.284106:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581405.284115:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581405.284124:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581405.284129:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581405.284138:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581405.284157:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581405.284164:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581405.284166:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788581405.284169:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788581405.284183:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:3.0:1788581405.284187:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581405.284194:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031e00/0x50f0cc74b7b2fb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fb9b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581405.284207:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581405.284209:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581405.284211:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581405.284322:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184218624:0@lo:400:kworker.0 00000100:00100000:1.0:1788581405.284330:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184218112:0@lo:400:kworker.0 00000100:00100000:2.0:1788581405.285574:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184218752:0@lo:39:umount.0 00000400:00000100:2.0:1788581405.285628:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184218752 offset 0 length 224: 4 00000100:00100000:0.0:1788581405.288983:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184217856:0@lo:400:kworker.0 00010000:00010000:1.0:1788581405.442949:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581406.465780:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581407.489692:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581407.553476:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788581407.553487:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788581408.513460:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581409.539490:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581410.561701:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581411.457433:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581396/real 1788581396] req@ffff995e7b2a0e00 x1875463184218368/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581411.457474:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e7b2a0e00 x1875463184218368/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581411 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581411.457499:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581411.458062:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788581411.458068:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184218368:0@lo:250:kworker.0 00000100:00080000:3.0:1788581411.459703:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788581411.459712:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788581411.459715:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581411.459722:0:15242:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 383 00000100:00080000:3.0:1788581411.459727:0:15242:0:(import.c:589:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581411.459733:0:15242:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e45134800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581411.459769:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43814e00 x1875463184218880/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581411.459960:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184218880:0@lo:250:kworker.0 00000400:00000100:2.0:1788581411.460009:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184218880 offset 0 length 520: 4 00010000:00010000:1.0:1788581411.587295:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581412.611960:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581413.633411:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581414.657933:0:10311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581415.553421:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581405/real 1788581405] req@ffff995d43bb7480 x1875463184218752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581415.553457:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43bb7480 x1875463184218752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581415.553477:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d42c3d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788581415.553500:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184218752:0@lo:39:umount.0 00000100:00080000:0.0:1788581415.553597:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788581415.553602:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788581415.553606:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788581415.554842:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.554860:0:15678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.554866:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.554872:0:15678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.555050:0:15678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581415.555060:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.555067:0:15678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.555073:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.555080:0:15678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581415.563786:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581415.563802:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581415.563811:0:15678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581415.563815:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e40031000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581415.563821:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581415.563823:0:15678:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1788581415.563836:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581415.563843:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581415.563849:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788581415.563852:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788581415.563855:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788581415.563872:0:6482:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:1.0:1788581415.563876:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581415.563883:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e40031000/0x50f0cc74b7b2fba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fba9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788581415.563927:0:15678:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1788581415.563928:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581415.563934:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788581415.563935:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1788581415.563942:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e429c2200 already unused, calling callback (ffffffffc1461c20) 00000020:00000080:0.0:1788581415.563945:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1788581415.563946:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581415.563955:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581415.563959:0:15678:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:1.0:1788581415.563962:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788581415.563966:0:15678:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff995e81dcb370) has no exports 10000000:01000000:1.0:1788581415.563969:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788581415.563973:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788581415.563974:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788581415.563982:0:6482:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:1.0:1788581415.563985:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581415.563991:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e429c2200/0x50f0cc74b7b2fe18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fe1f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788581415.563996:0:15678:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff995e81dcb370) has no exports 00010000:00010000:1.0:1788581415.564007:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581415.564010:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581415.564012:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581415.564135:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788581415.567396:0:15678:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d42df6720 - data ffff995e6b68c000/ffff995e6fb0f000 00000020:01000000:0.0:1788581415.568889:0:15678:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e6f053ae0 - data ffff995e6b6a7000/ffff995d43152400 00100000:10000000:0.0:1788581415.579980:0:15678:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788581415.592557:0:15678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fa28 00000020:00000080:0.0:1788581415.592569:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e7fa48800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788581415.592579:0:15678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6f944800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788581415.592582:0:15678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f944800 2 00000020:01000004:0.0:1788581415.592585:0:15678:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e6f944800 from lustre-OST0001 00000020:00000080:0.0:1788581415.592625:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581415.592634:0:15678:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788581415.592636:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e7fa4a000/lustre-OST0001_UUID 00000020:00000080:0.0:1788581415.592639:0:15678:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788581415.592645:0:15678:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788581415.592746:0:15678:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a41bfcf2-194f-415a-ba31-00ecb4f1e60f->MGS 00010000:00010000:0.0:1788581415.592760:0:15678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e429c3000/0x50f0cc74b7b2f781 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581415.592782:0:15678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e429c3000/0x50f0cc74b7b2f781 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581415.592789:0:15678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788581415.592792:0:15678:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788581415.592795:0:15678:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788581415.592817:0:15678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:0.0:1788581415.592820:0:15678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e429c3000/0x50f0cc74b7b2f781 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2f788 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788581415.592915:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa48800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:2.0:1788581415.593345:0:15678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581415.593354:0:15678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581415.593359:0:15678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581415.593362:0:15678:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788581415.593364:0:15678:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788581415.593383:0:15678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e45134800 00010000:00010000:2.0:1788581415.593387:0:15678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b2fc04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b2fc0b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788581415.593405:0:15678:0:(import.c:65:import_set_state_nolock()) ffff995e45134800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788581415.593418:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788581415.593420:0:15678:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788581415.593421:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788581415.593425:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788581415.593435:0:15678:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d43814e00 x1875463184218880/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788581431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788581415.593457:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788581415.593460:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788581415.593650:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a41bfcf2-194f-415a-ba31-00ecb4f1e60f:3617:1875463184218880:0@lo:250:kworker.0 10000000:01000000:2.0:1788581415.593720:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788581415.593727:0:15678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f67e 00000020:00000080:2.0:1788581415.593732:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e45131000/a41bfcf2-194f-415a-ba31-00ecb4f1e60f 00000020:01000000:2.0:1788581415.593749:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.103@tcp (flags='') 00000020:00000080:2.0:1788581415.593755:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581415.593760:0:15678:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788581415.593763:0:15678:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff995e7557cd28) has no exports 00000020:00000080:3.0:1788581415.593932:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e45131000/a41bfcf2-194f-415a-ba31-00ecb4f1e60f for MGC192.168.203.103@tcp 10000000:01000000:0.0:1788581415.593979:0:6490:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788581415.594628:0:15678:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.103@tcp: client import never connected 00000100:00080000:2.0:1788581415.594632:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788581415.594634:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788581415.594636:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788581415.594638:0:15678:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788581415.594689:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581415.594695:0:15678:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.103@tcp (uuid a41bfcf2-194f-415a-ba31-00ecb4f1e60f) 00000020:01000000:2.0:1788581415.594704:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788581415.594708:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581415.594712:0:15678:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581415.594717:0:15678:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff995d42e9f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581415.594722:0:15678:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff995d41c019b8) has exports, disconnecting them 00000020:00080000:2.0:1788581415.594726:0:15678:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff995d42e9f000), last request at 1788581199 00000020:00000080:2.0:1788581415.594730:0:15678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fa52 00000020:00080000:2.0:1788581415.594741:0:15678:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d42e9f000): rc 0 00000020:00000080:2.0:1788581415.594745:0:15678:0:(genops.c:885:class_export_put()) final put ffff995d42e9f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788581415.594965:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e45134800 for MGC192.168.203.103@tcp 00000020:00000080:3.0:1788581415.594972:0:15242:0:(genops.c:885:class_export_put()) final put ffff995e42f17000/a41bfcf2-194f-415a-ba31-00ecb4f1e60f 00000020:00000080:3.0:1788581415.594974:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e42f17000/a41bfcf2-194f-415a-ba31-00ecb4f1e60f for MGC192.168.203.103@tcp 00000020:01000000:3.0:1788581415.594980:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.103@tcp (a41bfcf2-194f-415a-ba31-00ecb4f1e60f) 00000020:00000080:3.0:1788581415.595246:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42e9f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788581415.604919:0:15678:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788581415.604928:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581415.604933:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788581415.604939:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788581415.605147:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581415.605157:0:15678:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788581415.605164:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788581415.605169:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581415.605173:0:15678:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788581415.605190:0:15678:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff995d42c3e800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581415.605196:0:15678:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff995e7a73b370) has exports, disconnecting them 00000020:00080000:0.0:1788581415.605201:0:15678:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff995d42c3e800), last request at 1788581199 00000020:00000080:0.0:1788581415.605205:0:15678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2fa67 00000020:00080000:0.0:1788581415.605219:0:15678:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d42c3e800): rc 0 00000020:00000080:0.0:1788581415.605224:0:15678:0:(genops.c:885:class_export_put()) final put ffff995d42c3e800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788581415.605462:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42e9a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788581415.605470:0:15242:0:(genops.c:885:class_export_put()) final put ffff995d41e5e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788581415.605473:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e5e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788581415.605479:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788581415.605979:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c3e800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788581415.635395:0:15678:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788581415.635406:0:15678:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581415.635411:0:15678:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581415.635419:0:15678:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581415.635452:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42c3d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788581415.635992:0:10311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788581415.637297:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788581415.637600:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788581415.637748:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff995e553faa00:6476] 0 exiting: rc = 1 00000100:00100000:2.0:1788581415.637818:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff995e553fb000:6477] 1 exiting: rc = 0 00000100:00100000:2.0:1788581415.637868:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.638104:0:6478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff995e4f273600:6478] 0 exiting: rc = 1 00000100:00100000:2.0:1788581415.638165:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff995e43ce6c00:6480] 2 exiting: rc = 0 00000100:00100000:2.0:1788581415.638220:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff995e42e3ae00:6479] 1 exiting: rc = 0 00000100:00100000:2.0:1788581415.638300:0:7444:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff995e6f863000:7444] 3 exiting: rc = 0 00000100:00100000:2.0:1788581415.638355:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.638362:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.638369:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.638374:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.638380:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642374:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642409:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642416:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642423:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642429:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642436:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642443:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642468:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642474:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642480:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642487:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642492:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642500:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642505:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642512:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642517:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642522:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642528:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642533:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642538:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642543:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642549:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642554:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642560:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642565:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642570:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642576:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642581:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642587:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642592:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642597:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642602:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642607:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642612:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642616:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642621:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642626:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642630:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642635:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642639:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642644:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642648:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642673:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642678:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642683:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642688:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642701:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642706:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642713:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642718:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642723:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642728:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642734:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642739:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642744:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642749:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642754:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642759:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581415.642764:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788581415.644629:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581415.644642:0:15678:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788581415.644648:0:15678:0:(genops.c:885:class_export_put()) final put ffff995d42c3f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788581415.644652:0:15678:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c3f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788581415.644668:0:15678:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788581415.644854:0:15678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6f944800 1 00000020:00000080:2.0:1788581415.644861:0:15678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b2f9f7 00000020:00000080:2.0:1788581415.644867:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e6f944000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788581415.644879:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788581415.644891:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6f944000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788581415.644900:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581415.644905:0:15678:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581415.644909:0:15678:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff995e7fa04d28) has no exports 00000020:00000080:0.0:1788581415.738584:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581415.738599:0:15678:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788581415.738605:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e7fa37000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788581415.738610:0:15678:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa37000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788581415.738618:0:15678:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788581415.738967:0:15678:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e7fa31000 00000020:01000000:0.0:1788581415.738990:0:15678:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788581415.738994:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581415.738999:0:15678:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581415.739003:0:15678:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff995e478719b8) has no exports 00000020:00000080:0.0:1788581415.739027:0:15678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581415.739033:0:15678:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788581415.739037:0:15678:0:(genops.c:885:class_export_put()) final put ffff995e6fadd000/OSS_uuid 00000020:00000080:0.0:1788581415.739039:0:15678:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fadd000/OSS_uuid for OSS 00000020:01000000:0.0:1788581415.739044:0:15678:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788581415.739229:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff995e6f03b400:8410] 2 exiting: rc = 0 00000100:00100000:0.0:1788581415.739453:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff995e6f03a000:8409] 1 exiting: rc = 0 00000100:00080000:3.0:1788581415.739729:0:6489:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788581415.739950:0:8906:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff995d4178ae00:8906] 3 exiting: rc = 0 00000100:00100000:3.0:1788581415.740191:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff995e81feaa00:8408] 0 exiting: rc = 1 00000100:00100000:0.0:1788581415.740293:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740301:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740307:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740313:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740320:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740325:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740330:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740335:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740353:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740359:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740364:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740369:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740374:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740379:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740384:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740389:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740394:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740399:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740405:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740411:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740416:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740422:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740427:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740432:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740437:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740442:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740451:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740459:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740464:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740471:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740476:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740481:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740487:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740491:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740495:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740503:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740508:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740512:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740517:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740522:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740527:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740532:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740536:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740547:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740552:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740556:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740561:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740565:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740570:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740574:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740579:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740584:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740588:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740593:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740597:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740601:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740605:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740612:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740617:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740623:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740628:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740633:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740637:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.740648:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581415.743548:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff995e81fe6200:8412] 1 exiting: rc = 0 00000100:00100000:3.0:1788581415.743643:0:10323:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff995d43345800:10323] 2 exiting: rc = 0 00000100:00100000:3.0:1788581415.743741:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff995e7a67fe00:8411] 0 exiting: rc = 1 00000100:00100000:0.0:1788581415.744322:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744331:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744339:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744344:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744350:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744355:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744360:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744365:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744370:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744376:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744409:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744415:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744420:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744425:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744443:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744448:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744453:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744459:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744463:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744468:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744473:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744478:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744482:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744487:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744492:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744497:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744502:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744506:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744511:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744522:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744529:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744532:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744536:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744541:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744545:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744550:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744555:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744560:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744564:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744569:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744574:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744579:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744584:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744589:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744594:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744598:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744603:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744608:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744613:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744625:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744631:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744636:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744641:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744646:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744651:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744667:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744672:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744682:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744689:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744694:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744699:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744705:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744711:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.744716:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.746437:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff995e81fe6e00:8415] 2 exiting: rc = 0 00000100:00100000:0.0:1788581415.746631:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff995e81ff1200:8414] 1 exiting: rc = 0 00000100:00100000:3.0:1788581415.746836:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff995e81fe7000:8413] 0 exiting: rc = 1 00000100:00100000:0.0:1788581415.746977:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.746984:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.746988:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.746994:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.746999:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747005:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747010:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747016:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747049:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747055:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747060:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747066:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747071:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747077:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747083:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747118:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747124:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747129:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747145:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747150:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747155:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747160:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747165:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747170:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747175:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747179:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747184:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747188:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747193:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747198:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747202:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747207:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747212:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747217:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747222:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747226:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747231:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747239:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747244:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747279:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747285:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747289:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747294:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747300:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747305:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747310:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747316:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747322:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747327:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747332:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747338:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747343:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747348:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747360:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747365:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747370:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747376:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747382:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747388:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747393:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747399:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747404:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747409:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.747422:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581415.752411:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff995e6bc04200:8416] 0 exiting: rc = 1 00000100:00100000:0.0:1788581415.752547:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff995e7a67c400:8417] 1 exiting: rc = 0 00000100:00100000:0.0:1788581415.752609:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752616:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752620:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752629:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752635:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752641:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752664:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752670:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752678:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752682:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752687:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752712:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752718:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752723:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752727:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752732:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752737:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752741:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752746:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752751:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752755:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752760:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752765:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752780:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752784:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752789:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752801:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752806:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752811:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752816:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752821:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752825:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752829:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752834:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752838:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752843:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752847:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752852:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752856:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752865:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752870:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752875:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752880:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752884:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752889:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752893:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752897:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752901:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752995:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.752999:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753004:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753010:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753015:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753020:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753025:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753033:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753038:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753052:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753064:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753069:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753075:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753080:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753143:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.753150:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581415.754294:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff995e6f8ba800:8418] 0 exiting: rc = 1 00000100:00100000:3.0:1788581415.754376:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff995e6f8bae00:8419] 1 exiting: rc = 0 00000100:00100000:0.0:1788581415.754471:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754479:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754492:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754499:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754504:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754511:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754516:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754522:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754527:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754533:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754538:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754555:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754563:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754568:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754574:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754579:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754585:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754590:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754597:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754603:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754610:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754616:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754622:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754644:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754651:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754669:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754677:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754683:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754691:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754707:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754713:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754719:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754725:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754731:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754738:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754757:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754765:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754771:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754778:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754784:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754794:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754878:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754886:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754893:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754900:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754907:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.754913:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755025:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755035:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755161:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755170:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755177:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755183:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755189:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755194:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755201:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755207:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755213:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755220:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755241:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755249:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755282:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755289:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581415.755303:0:15678:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788581415.778072:0:15678:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788581436.560458:0:16443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788581447.108072:0:17042:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581447.108083:0:17042:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788581447.108085:0:17042:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788581447.108197:0:17042:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e4eb3d800 00000020:01000004:2.0:1788581447.108210:0:17042:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788581447.108217:0:17042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788581447.108229:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff995e7a73b370) 00000020:00000080:2.0:1788581447.108241:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788581447.177963:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788581447.178199:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788581447.186249:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.187245:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.187512:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.187830:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.188385:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.188986:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.189214:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.191197:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.192103:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.192383:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.192588:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.192968:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788581447.193813:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788581447.195393:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.197444:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.197753:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.198072:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.198952:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.199322:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.199536:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.199968:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.200523:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.200936:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.202759:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.203152:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.203403:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.203744:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.204024:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.204375:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.205715:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.206446:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.206821:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.207181:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.207485:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.207752:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.208002:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.210937:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.211598:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788581447.211824:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788581447.212345:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788581447.212690:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788581447.213053:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788581447.213276:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788581447.213494:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788581447.213698:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788581447.215546:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788581447.215954:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788581447.216214:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788581447.217037:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788581447.217239:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788581447.218064:0:17042:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788581447.219228:0:17042:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788581447.219700:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788581447.219708:0:17042:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581447.219718:0:17042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30c3b 00000020:01000004:3.0:1788581447.219725:0:17042:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788581447.219730:0:17042:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788581447.219735:0:17042:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e4eb3d800 from MGS 00000020:01000004:3.0:1788581447.219738:0:17042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788581447.219748:0:17042:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff995e81dc99b8) 00000020:00000080:3.0:1788581447.219756:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788581447.219807:0:17042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e4eb3d800 from MGS, refs=2 00080000:01000000:3.0:1788581447.219811:0:17042:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581447.219815:0:17042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30c49 00000100:00100000:3.0:1788581447.220155:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788581447.220506:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788581447.220580:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788581447.221194:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788581447.221202:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788581447.222125:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581447.222968:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788581447.222976:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788581447.226699:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788581447.226712:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788581447.228760:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788581447.228774:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788581447.229978:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.229982:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.229984:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.230423:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.230426:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.230427:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581447.231012:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788581447.241831:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788581447.245055:0:17042:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788581447.252011:0:17055:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788581447.252050:0:17042:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788581447.252104:0:17042:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788581447.262110:0:17042:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788581447.262823:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581447.263047:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788581447.263053:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788581447.263719:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788581447.263727:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788581447.264081:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788581447.264088:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788581447.273467:0:17059:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788581447.273521:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788581447.273542:0:17042:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:2.0:1788581447.273544:0:17042:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788581447.273581:0:17042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:2.0:1788581447.273594:0:17042:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (ffff995e7a7399b8) 00000020:00000080:2.0:1788581447.273608:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788581447.273684:0:17042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4eb3d000@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581447.273826:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:2.0:1788581447.273832:0:17042:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788581447.276948:0:17060:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788581447.277040:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid 611141c5-6f74-41ea-b38f-6fb1248f7899) 00000020:00000080:3.0:1788581447.277064:0:17042:0:(genops.c:1385:class_connect()) connect: client 611141c5-6f74-41ea-b38f-6fb1248f7899, cookie 0x50f0cc74b7b30c57 00000100:00080000:3.0:1788581447.277075:0:17042:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581447.277088:0:17042:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e4eb3d000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581447.277121:0:17042:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43814700 x1875463184219008/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581447.277147:0:17042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS 00000020:01000004:3.0:1788581447.277176:0:17042:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1788581447.277180:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184219008:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1788581447.277182:0:17042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788581447.277195:0:17042:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff995e81dccd28) 00000020:00000080:3.0:1788581447.277205:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788581447.277243:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581447.277533:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219008 00000100:00100000:0.0:1788581447.277541:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219008 00000100:00100000:0.0:1788581447.277567:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581447.277575:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1875463184219008:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788581447.277598:0:17056:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 611141c5-6f74-41ea-b38f-6fb1248f7899@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1788581447.277618:0:17056:0:(genops.c:1385:class_connect()) connect: client 611141c5-6f74-41ea-b38f-6fb1248f7899, cookie 0x50f0cc74b7b30c65 00000100:00080000:0.0:1788581447.277730:0:17056:0:(import.c:65:import_set_state_nolock()) ffff995d43bf1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581447.277786:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+5:3617:x1875463184219008:12345-0@lo:250:mount.lustre.0 Request processed in 210us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581447.277793:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581447.277856:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788581447.277863:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788581447.277870:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788581447.277874:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788581447.277877:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788581447.277879:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788581447.277885:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788581447.277889:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184219008:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788581447.292858:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581447.294367:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581447.294374:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788581447.296501:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788581447.296512:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788581447.300160:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581447.300171:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788581447.301063:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581447.301234:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788581447.301240:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788581447.303695:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788581447.303708:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788581447.342514:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581447.342741:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788581447.342747:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788581447.344620:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788581447.344632:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788581447.346201:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581447.346418:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581447.346425:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788581447.347121:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788581447.347129:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788581447.348898:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581447.349138:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581447.349145:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788581447.350596:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581447.350607:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788581447.351659:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581447.351927:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581447.351932:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788581447.352539:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581447.352546:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788581447.370905:0:17042:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581447.371097:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788581447.371104:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788581447.375847:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581447.375864:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788581447.376788:0:17042:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788581447.376797:0:17042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788581447.377587:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788581447.377618:0:17042:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788581447.377624:0:17042:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788581447.377729:0:17042:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581447.377777:0:17042:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788581447.377782:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581447.377784:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581447.377785:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581447.377786:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581447.377787:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581447.377788:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581447.377790:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581447.377791:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581447.377793:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581447.377795:0:17042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581447.377797:0:17042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788581447.377799:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581447.377800:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581447.377801:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581447.377802:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581447.377803:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581447.377804:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581447.377805:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581447.377806:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581447.377807:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581447.377808:0:17042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581447.377841:0:17042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788581447.377863:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219136:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581447.377948:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581447.378013:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.378165:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219136 00000100:00100000:3.0:1788581447.378175:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219136 00000100:00100000:3.0:1788581447.378222:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581447.378232:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+5:17042:x1875463184219136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581447.378305:0:17058:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581447.378309:0:17058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788581447.378312:0:17058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788581447.378791:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788581447.380194:0:17058:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788581447.384122:0:17080:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788581447.384131:0:17080:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788581447.384134:0:17080:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788581447.384137:0:17080:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788581447.384409:0:17080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788581447.384644:0:17058:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581447.384654:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788581447.386622:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+5:17042:x1875463184219136:12345-0@lo:253:mount.lustre.0 Request processed in 8383us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.386637:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581447.386821:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788581447.386837:0:17042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788581447.386840:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581447.386842:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581447.386843:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581447.386845:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581447.386846:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581447.386847:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581447.386848:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581447.386850:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581447.386851:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581447.386853:0:17042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581447.386872:0:17042:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e4eb3d800 from lustre-MDT0000 10000000:01000000:2.0:1788581447.386917:0:17042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788581447.386921:0:17042:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581447.386934:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff995e7a7399b8 10000000:01000000:2.0:1788581447.386939:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581447.386946:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e7a7399b8 from 1 10000000:01000000:2.0:1788581447.386948:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581447.386985:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.386995:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.387003:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.387021:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581447.387056:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.387098:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.389203:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219264 00000100:00100000:3.0:1788581447.389217:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219264 00000100:00100000:3.0:1788581447.389297:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581447.389309:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+5:17042:x1875463184219264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581447.389324:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581447.389347:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f981800/0x50f0cc74b7b30c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30c6c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.389393:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f981800/0x50f0cc74b7b30c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c6c expref: 6 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.389404:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f981800/0x50f0cc74b7b30c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c6c expref: 6 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.389414:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981800, rc 0) 00000100:00100000:3.0:1788581447.389505:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+6:17042:x1875463184219264:12345-0@lo:101:mount.lustre.0 Request processed in 199us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.389512:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581447.389689:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.389708:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.389717:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.389790:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.389824:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.389852:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.389912:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219392 00000100:00100000:3.0:1788581447.389917:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219392 00000100:00100000:3.0:1788581447.389946:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581447.389954:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+6:17042:x1875463184219392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581447.390030:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+6:17042:x1875463184219392:12345-0@lo:501:mount.lustre.0 Request processed in 76us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788581447.390037:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581447.390168:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219392:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788581447.390197:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581447.390223:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390232:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581447.390240:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e4eb3d800 10000000:01000000:2.0:1788581447.390244:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788581447.390248:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e4eb3d800 10000000:01000000:2.0:1788581447.390251:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788581447.390282:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e4eb3d800 from 1 10000000:01000000:2.0:1788581447.390284:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788581447.390305:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390312:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390320:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.390333:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581447.390359:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.390380:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581447.390444:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219520 00000100:00100000:1.0:1788581447.390448:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219520 00000100:00100000:1.0:1788581447.390489:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581447.390505:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+6:17042:x1875463184219520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581447.390513:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581447.390524:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b30c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30c7a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581447.390540:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b30c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c7a expref: 7 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581447.390548:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b30c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c7a expref: 7 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581447.390555:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4600, rc 0) 00000100:00100000:1.0:1788581447.390586:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+7:17042:x1875463184219520:12345-0@lo:101:mount.lustre.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581447.390592:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581447.390668:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.390679:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390687:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581447.390703:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788581447.390708:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390714:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581447.390720:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581447.390724:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581447.390728:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e4eb3d800 10000000:01000000:2.0:1788581447.390731:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788581447.390734:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788581447.390736:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581447.390750:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390757:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390764:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.390777:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581447.390802:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.390827:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219648 00000100:00100000:2.0:1788581447.390831:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219648 00000100:00100000:2.0:1788581447.390863:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581447.390870:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+7:17042:x1875463184219648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.390895:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581447.390904:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44c00/0x50f0cc74b7b30c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30c88 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390919:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44c00/0x50f0cc74b7b30c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c88 expref: 8 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390927:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44c00/0x50f0cc74b7b30c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30c88 expref: 8 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.390934:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44c00, rc 0) 00000100:00100000:2.0:1788581447.390959:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+8:17042:x1875463184219648:12345-0@lo:101:mount.lustre.0 Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.390965:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581447.390988:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.390999:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.391008:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.391016:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.391070:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.391093:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.391112:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219776 00000100:00100000:2.0:1788581447.391115:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219776 00000100:00100000:2.0:1788581447.391134:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581447.391140:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+8:17042:x1875463184219776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.391279:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17042:x1875463184219776:12345-0@lo:501:mount.lustre.0 Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.391287:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581447.391310:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.391321:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.391344:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581447.391380:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.391398:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184219904 00000100:00100000:2.0:1788581447.391401:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184219904 00000100:00100000:2.0:1788581447.391420:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581447.391426:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17042:x1875463184219904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.392498:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.392661:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17042:x1875463184219904:12345-0@lo:503:mount.lustre.0 Request processed in 1232us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.392669:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581447.398115:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184219904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581447.398746:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17081:1875463184220032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581447.398820:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581447.398970:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220032 00000100:00100000:1.0:1788581447.398978:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220032 00000100:00100000:0.0:1788581447.398988:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581447.399030:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581447.399040:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17081:x1875463184220032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581447.399889:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17081:x1875463184220032:12345-0@lo:502:llog_process_th.0 Request processed in 839us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581447.399899:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581447.402651:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17081:1875463184220032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581447.402704:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581447.402720:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581447.402722:0:17081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788581447.402727:0:17081:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788581447.402731:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581447.402747:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff995e7fa04d28) 00000020:00000080:0.0:1788581447.402770:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788581447.402778:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788581447.402876:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788581447.402884:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30c9d 00000020:00000080:0.0:1788581447.403111:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788581447.403116:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581447.403119:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581447.403120:0:17081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788581447.403123:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581447.403127:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581447.403128:0:17081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788581447.403131:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581447.403139:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff995e7fa00000) 00000020:00000080:0.0:1788581447.403148:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788581447.403152:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788581447.403154:0:17081:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788581447.403156:0:17081:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788581447.403161:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788581447.403204:0:17081:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e4eb3d800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788581447.403217:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff995e7fa019b8) 00000020:00000080:0.0:1788581447.403231:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788581447.403323:0:17081:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788581447.403329:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30cb2 00000020:00000080:0.0:1788581447.403433:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788581447.403439:0:17081:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788581447.403444:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x50f0cc74b7b30cb9 00080000:01000000:0.0:1788581447.403449:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788581447.403467:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30cc0 00010000:00010000:1.0:1788581447.518826:0:17081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788581447.519281:0:17081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1788581447.519936:0:17081:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788581447.520440:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff995d42c03370) 00000020:00000080:1.0:1788581447.520469:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788581447.520544:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788581447.520559:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30cce 00000020:00000080:1.0:1788581447.529699:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788581447.535869:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x50f0cc74b7b30cd5 00000020:00000080:2.0:1788581447.536402:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788581447.536414:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581447.536420:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.536422:0:17081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788581447.536425:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581447.536428:0:17081:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788581447.536429:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581447.536431:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581447.536433:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581447.536435:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.536437:0:17081:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581447.536439:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581447.536443:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.536450:0:17081:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788581447.537472:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788581447.537522:0:17081:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788581447.537542:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581447.537545:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.537546:0:17081:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788581447.537549:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581447.537554:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.537555:0:17081:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788581447.537558:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581447.537563:0:17081:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1788581447.537592:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581447.537608:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff995e7a73cd28) 00000020:00000080:2.0:1788581447.537624:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788581447.537628:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581447.537684:0:17081:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788581447.537689:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788581447.537999:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30ce3 00010000:00080000:2.0:1788581447.538035:0:17081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d43bf2800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581447.543786:0:17081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788581447.545314:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581447.545330:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788581447.545364:0:17081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788581447.545386:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30cea 00000100:00080000:2.0:1788581447.545397:0:17081:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581447.545402:0:17081:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995d43bf2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581447.545438:0:17081:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43bb7480 x1875463184220160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581447.545475:0:17081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788581447.545523:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581447.545528:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.545539:0:17081:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788581447.545543:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581447.545546:0:17081:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788581447.545547:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581447.545549:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581447.545550:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581447.545552:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.545554:0:17081:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581447.545557:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788581447.545561:0:17081:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788581447.545564:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581447.545566:0:17081:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788581447.545569:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581447.545572:0:17081:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1788581447.545595:0:17081:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788581447.545599:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1788581447.545602:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220160:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788581447.545613:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff995e7a738000) 00000020:00000080:2.0:1788581447.545626:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788581447.545631:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788581447.545692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788581447.545697:0:17081:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788581447.545704:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788581447.545710:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30cf8 00000100:00100000:2.0:1788581447.545758:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220160 00000100:00100000:2.0:1788581447.545766:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220160 00000100:00100000:2.0:1788581447.545805:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581447.545812:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184220160:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788581447.545827:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788581447.549370:0:17081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e72849000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1788581447.549631:0:17081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788581447.558522:0:17081:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788581447.559881:0:17081:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581447.563870:0:17081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581447.564228:0:17081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788581447.573558:0:17081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788581447.576930:0:17087:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581447.576940:0:17087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788581447.578340:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581447.578355:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788581447.578395:0:17081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788581447.578415:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30cff 00000100:00080000:3.0:1788581447.578425:0:17081:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581447.578430:0:17081:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581447.578485:0:17081:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43815c00 x1875463184220288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581447.578508:0:17081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788581447.578564:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.578569:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.578571:0:17081:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788581447.578574:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788581447.578577:0:17081:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788581447.578579:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581447.578580:0:17081:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581447.578582:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788581447.578584:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.578585:0:17081:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788581447.578588:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788581447.578591:0:17081:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788581447.578594:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.578596:0:17081:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788581447.578599:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788581447.578602:0:17081:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1788581447.578627:0:17081:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788581447.578629:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581447.578641:0:17081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff995e81dcb370) 00000020:00000080:3.0:1788581447.578653:0:17081:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788581447.578657:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788581447.578711:0:17081:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788581447.578717:0:17081:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788581447.578723:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b30d0d 00010000:00080000:3.0:1788581447.578761:0:17081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4f27e000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581447.578968:0:17081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788581447.579033:0:17081:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788581447.579047:0:17081:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788581447.580223:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220288:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788581447.580372:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184220288 offset 0 length 520: 4 00000040:00080000:3.0:1788581447.581580:0:17081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581447.582388:0:17081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788581447.582553:0:17081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788581447.585144:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184220160:12345-0@lo:38:llog_process_th.0 Request processed in 39326us (39447us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581447.585182:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788581447.585612:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581447.585619:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581447.585623:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220160:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788581447.585903:0:17089:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788581447.585908:0:17089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788581447.586866:0:17081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581447.586878:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788581447.586988:0:17081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788581447.587007:0:17081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30d14 00000100:00080000:3.0:1788581447.587015:0:17081:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581447.587021:0:17081:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e4f27e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581447.587053:0:17081:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43814380 x1875463184220416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581447.587112:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788581447.587160:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184220416 offset 0 length 520: 4 00000100:00080000:3.0:1788581447.587212:0:17081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788581447.587302:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.587307:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.587309:0:17081:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788581447.587312:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.587316:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.587317:0:17081:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581447.587320:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581447.587321:0:17081:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581447.587324:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.587326:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.587327:0:17081:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788581447.587330:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.587332:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.587333:0:17081:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581447.587337:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788581447.587365:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17081:1875463184220544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.587424:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.587440:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.587574:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220544 00000100:00100000:2.0:1788581447.587581:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220544 00000100:00100000:2.0:1788581447.587629:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581447.587638:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17081:x1875463184220544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581447.587775:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17081:x1875463184220544:12345-0@lo:502:llog_process_th.0 Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.587782:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581447.588000:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17081:1875463184220544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581447.588023:0:17081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.588028:0:17081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.588030:0:17081:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581447.588033:0:17081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788581447.588498:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788581447.588523:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581447.588544:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588555:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581447.588564:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3d800 from 1 10000000:01000000:2.0:1788581447.588567:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581447.588596:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588603:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588613:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.588629:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581447.588666:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.588691:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.588710:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220672 00000100:00100000:2.0:1788581447.588715:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220672 00000100:00100000:2.0:1788581447.588741:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581447.588854:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+9:17042:x1875463184220672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.588874:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581447.588949:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d1b expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588972:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 10 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588982:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 10 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.588991:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb45e00, rc 0) 00000100:00100000:2.0:1788581447.589033:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+10:17042:x1875463184220672:12345-0@lo:101:mount.lustre.0 Request processed in 180us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.589039:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581447.589108:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581447.589121:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.589129:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581447.589719:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220800:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788581447.589970:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.590067:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581447.590475:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220800 00000100:00100000:1.0:1788581447.590482:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220800 00000100:00100000:1.0:1788581447.590551:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581447.590560:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+10:17042:x1875463184220800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788581447.590577:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788581447.590584:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788581447.590660:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+10:17042:x1875463184220800:12345-0@lo:256:mount.lustre.0 Request processed in 100us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581447.590666:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581447.590724:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220800:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788581447.591527:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581447.591552:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.591564:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581447.591573:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3d800 from 1 10000000:01000000:3.0:1788581447.591576:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581447.591668:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.591676:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.591684:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581447.591701:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788581447.591750:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.592102:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.592161:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184220928 00000100:00100000:2.0:1788581447.592167:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184220928 00000100:00100000:2.0:1788581447.592202:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581447.592209:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+10:17042:x1875463184220928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.592221:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581447.592234:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d29 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.592280:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.592428:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.592437:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44200, rc 0) 00000100:00100000:2.0:1788581447.592503:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184220928:12345-0@lo:101:mount.lustre.0 Request processed in 294us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.592510:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581447.592593:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184220928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581447.592606:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.592614:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581447.592670:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581447.592696:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.592716:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.592829:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221056 00000100:00100000:2.0:1788581447.592834:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221056 00000100:00100000:2.0:1788581447.592855:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581447.592860:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184221056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.593089:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184221056:12345-0@lo:501:mount.lustre.0 Request processed in 227us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.593096:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581447.593515:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581447.593548:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.593592:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.593622:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581447.593669:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221184 00000100:00100000:2.0:1788581447.593674:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221184 00000100:00100000:2.0:1788581447.593706:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581447.593713:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184221184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581447.593813:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184221184:12345-0@lo:503:mount.lustre.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581447.593820:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581447.594003:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.594546:0:17091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17091:1875463184221312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.594588:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.594619:0:17091:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581447.594671:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221312 00000100:00100000:1.0:1788581447.594677:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221312 00000100:00100000:1.0:1788581447.594711:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581447.594719:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17091:x1875463184221312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581447.595186:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17091:x1875463184221312:12345-0@lo:502:llog_process_th.0 Request processed in 466us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581447.595194:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581447.595319:0:17091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17091:1875463184221312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581447.595344:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.595353:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595356:0:17091:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788581447.595363:0:17091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4eb3d800 00000020:00000080:3.0:1788581447.595365:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581447.595373:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.595375:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595377:0:17091:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788581447.595379:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.595381:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595382:0:17091:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788581447.595386:0:17091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e4eb3d800 00000020:00000080:3.0:1788581447.595388:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581447.595438:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.595442:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595443:0:17091:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788581447.595446:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.595448:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595450:0:17091:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581447.595466:0:17091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4eb3d800 00000020:00000080:3.0:1788581447.595468:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581447.595486:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.595489:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595490:0:17091:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581447.595493:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581447.595495:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595496:0:17091:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788581447.595507:0:17091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e4eb3d800 00000020:00000080:3.0:1788581447.595509:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788581447.595544:0:17091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17091:1875463184221440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.595580:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.595604:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221440 00000100:00100000:3.0:1788581447.595608:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221440 00000100:00100000:3.0:1788581447.595633:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581447.595639:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17091:x1875463184221440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.595709:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17091:x1875463184221440:12345-0@lo:502:llog_process_th.0 Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.595716:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581447.595765:0:17091:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.595778:0:17091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17091:1875463184221440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581447.595796:0:17091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581447.595799:0:17091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581447.595801:0:17091:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788581447.595804:0:17091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788581447.597953:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788581447.597987:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581447.598016:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.598029:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581447.598085:0:17042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788581447.598089:0:17042:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e4eb3d800 10000000:01000000:2.0:1788581447.598092:0:17042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e4eb3d800 10000000:01000000:2.0:1788581447.598101:0:17042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581447.598107:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e4eb3d800 from 1 10000000:01000000:2.0:1788581447.598110:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581447.598143:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.598152:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.598164:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.598187:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581447.598245:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.598317:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.598856:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221568 00000100:00100000:3.0:1788581447.598865:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221568 00000100:00100000:3.0:1788581447.598974:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581447.598984:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17042:x1875463184221568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581447.598996:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581447.599008:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f981c00/0x50f0cc74b7b30d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d37 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.599030:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f981c00/0x50f0cc74b7b30d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d37 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.599052:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f981c00/0x50f0cc74b7b30d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d37 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.599061:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981c00, rc 0) 00000100:00100000:3.0:1788581447.599106:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184221568:12345-0@lo:101:mount.lustre.0 Request processed in 124us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.599113:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581447.599398:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581447.599413:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.599422:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.599495:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581447.599523:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.599551:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.600856:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221696 00000100:00100000:3.0:1788581447.600865:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221696 00000100:00100000:3.0:1788581447.600970:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581447.600980:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184221696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581447.601127:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184221696:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.601134:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581447.601506:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581447.601547:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.601593:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.601621:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.601637:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221824 00000100:00100000:3.0:1788581447.601642:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221824 00000100:00100000:3.0:1788581447.601667:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581447.601675:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184221824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.601962:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184221824:12345-0@lo:503:mount.lustre.0 Request processed in 287us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.601970:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581447.602017:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184221824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581447.604109:0:17093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184221952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.604181:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.606045:0:17093:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581447.606302:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184221952 00000100:00100000:0.0:1788581447.606311:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184221952 00000100:00100000:0.0:1788581447.606361:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581447.606370:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184221952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581447.606536:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184221952:12345-0@lo:502:llog_process_th.0 Request processed in 166us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581447.606543:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581447.606550:0:17093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184221952:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788581447.606614:0:17093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788581447.606629:0:17093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff995e81dc8000) 00000020:00000080:3.0:1788581447.606646:0:17093:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788581447.606733:0:17093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e4eb3d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581447.606809:0:17093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4eb3d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581447.606812:0:17093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3d800 4 00010000:00080000:3.0:1788581447.606849:0:17093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4f27d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581447.618521:0:17093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788581447.618727:0:17093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788581447.618780:0:17093:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581447.618795:0:17093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x50f0cc74b7b30d4c 00000100:00080000:3.0:1788581447.618805:0:17093:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581447.618811:0:17093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff995e4f27d800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581447.618846:0:17093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43816d80 x1875463184222080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581447.620542:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184222080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788581447.620615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581447.620707:0:17093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788581447.620933:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222080 00000100:00100000:2.0:1788581447.620941:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222080 00000100:00100000:2.0:1788581447.620973:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581447.620981:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184222080:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788581447.621045:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184222080:12345-0@lo:38:llog_process_th.0 Request processed in 63us (429us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788581447.621053:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581447.622072:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581447.622083:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581447.622088:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788581447.622099:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184222080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788581447.622664:0:17093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184222208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.622727:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.622773:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222208 00000100:00100000:3.0:1788581447.622779:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222208 00000100:00100000:3.0:1788581447.622816:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581447.622825:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184222208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.623569:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184222208:12345-0@lo:502:llog_process_th.0 Request processed in 742us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.623578:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581447.623628:0:17093:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.623646:0:17093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184222208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.623690:0:17093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184222336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.623724:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.624584:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222336 00000100:00100000:3.0:1788581447.624592:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222336 00000100:00100000:3.0:1788581447.624626:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581447.624634:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184222336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581447.624726:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17093:x1875463184222336:12345-0@lo:502:llog_process_th.0 Request processed in 93us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.624733:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581447.624797:0:17093:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.624812:0:17093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:611141c5-6f74-41ea-b38f-6fb1248f7899:17093:1875463184222336:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788581447.624838:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788581447.626771:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788581447.626801:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581447.626873:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.626886:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788581447.626936:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788581447.626938:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581447.626939:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581447.626941:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581447.626942:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581447.626944:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581447.626945:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581447.626947:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581447.626948:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581447.626949:0:17042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581447.626953:0:17042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788581447.626956:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581447.626957:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581447.626958:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581447.626959:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581447.626960:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581447.626961:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581447.626962:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581447.626963:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581447.626964:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581447.626965:0:17042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581447.626988:0:17042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788581447.627005:0:17042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184222464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581447.627064:0:17042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.628976:0:17042:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44eeed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.629027:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222464 00000100:00100000:3.0:1788581447.629037:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222464 00000100:00100000:3.0:1788581447.629094:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788581447.629104:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184222464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581447.629135:0:17056:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788581447.629148:0:17056:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788581447.631168:0:17056:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788581447.631214:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788581447.631378:0:17079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788581447.631383:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788581447.631405:0:17079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.631424:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.631432:0:17079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.631614:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581447.631629:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581447.631643:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184222592:0@lo:104: 00000100:00100000:2.0:1788581447.631682:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581447.631728:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a63ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581447.631824:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17042:x1875463184222464:12345-0@lo:253:mount.lustre.0 Request processed in 2720us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.631834:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788581447.631893:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222592 00000100:00100000:3.0:1788581447.631900:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222592 00000100:00100000:3.0:1788581447.631938:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581447.631947:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184222592:12345-0@lo:104: 00010000:00010000:3.0:1788581447.631958:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632002:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581447.632007:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184222592:12345-0@lo:104: Request processed in 63us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.632014:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581447.632043:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184222592:0@lo:104: 00010000:00010000:3.0:1788581447.632060:0:17079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632200:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581447.632207:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632226:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581447.632230:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632239:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581447.632246:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581447.632293:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581447.632321:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632328:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581447.632349:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632356:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb44000/0x50f0cc74b7b30d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d22 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632372:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.632374:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581447.632375:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581447.632403:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184222720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581447.632434:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581447.632514:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222720 00000100:00100000:3.0:1788581447.632518:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222720 00010000:00010000:3.0:1788581447.632533:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581447.632561:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581447.632568:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:3621:x1875463184222720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581447.632578:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581447.632583:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632593:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632606:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45e00/0x50f0cc74b7b30d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30d1b expref: 12 pid: 17058 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632618:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632626:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581447.632636:0:17048:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001254193s 00010000:00010000:3.0:1788581447.632641:0:17048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632647:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632654:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632661:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632671:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581447.632675:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632682:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632694:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.632963:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581447.633039:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+11:3621:x1875463184222720:12345-0@lo:103:ldlm_bl.0 Request processed in 470us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581447.633047:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788581447.633103:0:17079:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.633110:0:17079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581447.633117:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581447.633407:0:17042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17042:1875463184222464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581447.633420:0:17042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788581447.633423:0:17042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581447.633425:0:17042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581447.633426:0:17042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581447.633428:0:17042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581447.633429:0:17042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581447.633430:0:17042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581447.633431:0:17042:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581447.633432:0:17042:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581447.633434:0:17042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581447.633435:0:17042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788581447.633446:0:17042:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788581447.635045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184222720:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788581447.652584:0:17042:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788581447.653054:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788581447.653121:0:17103:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788581447.653125:0:17103:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788581447.653436:0:17104:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581447.653600:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788581447.653981:0:17105:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff995d43bb4e00 x1875463184222848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581447.653992:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000040:01000000:1.0:1788581447.654429:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788581447.654479:0:17042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788581447.655160:0:17042:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788581447.655172:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788581447.655219:0:17042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581447.658187:0:17042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788581447.659547:0:17104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581447.661875:0:17042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788581447.662557:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788581447.668605:0:17042:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000040:00080000:2.0:1788581447.670272:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581447.670863:0:17104:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1788581447.677156:0:17042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788581447.680980:0:17042:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788581447.681023:0:17042:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffabf141c4b988 00100000:10000000:2.0:1788581447.681031:0:17042:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788581447.682312:0:17042:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581447.682328:0:17042:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581447.682630:0:17042:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788581447.682655:0:17042:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788581447.683494:0:17042:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581447.683704:0:17042:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788581448.257690:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581448.641932:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788581448.707931:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 10000000:01000000:3.0:1788581448.898332:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581448.898339:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3d800 from 7 10000000:01000000:3.0:1788581448.898343:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581448.898383:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581448.898403:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581448.898416:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581448.898440:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184222976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581448.898632:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581448.898682:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581448.898731:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222976 00000100:00100000:0.0:1788581448.898738:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222976 00000100:00100000:0.0:1788581448.898788:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581448.898798:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+11:17060:x1875463184222976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581448.898811:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581448.898826:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d5a expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581448.898848:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581448.898858:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581448.898878:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71000, rc 0) 00000100:00100000:0.0:1788581448.898917:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17060:x1875463184222976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581448.898923:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581448.899003:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184222976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581448.899016:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581448.899025:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581448.899070:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184223104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581448.899097:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581448.902151:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581448.908545:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223104 00000100:00100000:0.0:1788581448.908558:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223104 00000100:00100000:3.0:1788581448.910139:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581448.910157:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17060:x1875463184223104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788581448.910194:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581448.910212:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581448.910216:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788581448.912655:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17060:x1875463184223104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2497us (13548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581448.912676:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581448.912722:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184223104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788581448.912772:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581448.912782:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581448.912792:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581449.283159:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581449.667781:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788581449.729468:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788581450.310349:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581450.753345:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788581451.335877:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581451.778029:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000001:02000400:2.0:1788581451.873305:0:17348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788581452.357121:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788581452.784020:0:17400:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581452.785994:0:17400:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788581452.804185:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000100:00080000:3.0:1788581453.126729:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581453.126736:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788581453.126740:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581453.126748:0:15242:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1788581453.126753:0:15242:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788581453.126760:0:15242:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995d43bf2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581453.126784:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817b80 x1875463184223360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581453.126804:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581453.126817:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581453.126819:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581453.126822:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581453.126825:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581453.126828:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788581453.126829:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e4f27d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788581453.128006:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581453.128028:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184223232:0@lo:400:kworker.0 00000100:00100000:2.0:1788581453.128110:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581453.128320:0:15242:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff995e4f27d800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581453.128348:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43816680 x1875463184223488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581453.130784:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223360:0@lo:38:kworker.0 00000100:00100000:2.0:1788581453.130869:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581453.130921:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184223488:0@lo:38:kworker.0 00000100:00100000:2.0:1788581453.130950:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581453.131000:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223488 00000100:00100000:2.0:1788581453.131008:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223488 00000100:00100000:2.0:1788581453.131050:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581453.131061:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184223488:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788581453.131090:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788581453.131129:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x50f0cc74b7b30d68 00000004:00100000:2.0:1788581453.131147:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788581453.131349:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995e71e5c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581453.131406:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875463184223488:12345-0@lo:38:kworker.0 Request processed in 343us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581453.131431:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581453.131482:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43816680 x1875463184223488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581453.131500:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788581453.131511:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788581453.131516:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581453.131518:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581453.131528:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184223488:0@lo:38:kworker.0 00000100:00100000:0.0:1788581453.132095:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223360 00000100:00100000:0.0:1788581453.132102:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223360 00000100:00100000:0.0:1788581453.132136:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581453.132142:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184223360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788581453.132161:0:17069:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788581453.133669:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223232 00000100:00100000:3.0:1788581453.133684:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223232 00000100:00100000:3.0:1788581453.133742:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581453.133750:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:3619:x1875463184223232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581453.133854:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:3619:x1875463184223232:12345-0@lo:400:kworker.0 Request processed in 97us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581453.133862:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581453.133924:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184223232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581453.155374:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184223360:12345-0@lo:38:kworker.0 Request processed in 23223us (24497us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581453.155388:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788581453.155838:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581453.155851:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581453.155855:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223360:0@lo:38:kworker.0 00010000:00010000:0.0:1788581453.379037:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581453.828739:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000020:00000004:0.0:1788581453.904442:0:17450:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581453.904717:0:17450:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581454.403588:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581454.850827:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788581455.431190:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581455.877444:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788581456.449654:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581456.900126:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000100:00100000:2.0:1788581457.217399:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581447/real 1788581447] req@ffff995d43814380 x1875463184220416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581457.217443:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43814380 x1875463184220416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581457 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581457.217455:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581447/real 1788581447] req@ffff995d43815c00 x1875463184220288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581457.217469:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43815c00 x1875463184220288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581457 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581457.217491:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581457.217521:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581457.217525:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788581457.217545:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581457.217560:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581457.217564:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184220288:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788581457.219494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581457.219504:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788581457.219508:0:8:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581457.219517:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:3.0:1788581457.219532:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581457.219542:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995d43bf2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581457.219572:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43815f80 x1875463184223744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581457.219594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581457.219598:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788581457.219600:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581457.219604:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1788581457.219607:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788581457.219611:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581457.219624:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817100 x1875463184223872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581457.219633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581457.219636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788581457.219637:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581457.219641:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1788581457.219644:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788581457.219647:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e4f27e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581457.219660:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43815180 x1875463184224000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581457.219711:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581457.219732:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184223616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581457.220282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581457.220370:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184224128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581457.220570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581457.220613:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223616 00000100:00100000:3.0:1788581457.220622:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223616 00000100:00100000:3.0:1788581457.220686:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581457.220698:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:3618:x1875463184223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581457.220759:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+12:3618:x1875463184223616:12345-0@lo:400:kworker.0 Request processed in 64us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581457.220768:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581457.220958:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223744:0@lo:38:kworker.0 00000100:00100000:2.0:1788581457.220999:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581457.221027:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223872:0@lo:8:kworker.0 00000400:00000100:2.0:1788581457.221054:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184223872 offset 0 length 520: 4 00000100:00100000:2.0:1788581457.221075:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184224000:0@lo:8:kworker.0 00000400:00000100:2.0:1788581457.221097:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184224000 offset 0 length 520: 4 00000100:00100000:2.0:1788581457.221124:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184223744 00000100:00100000:2.0:1788581457.221129:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184223744 00000100:00100000:2.0:1788581457.221157:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581457.221163:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184223744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581457.221184:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788581457.221977:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224128 00000100:00100000:3.0:1788581457.221987:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224128 00000100:00100000:3.0:1788581457.222030:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581457.222040:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581457.222110:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184224128:12345-0@lo:400:kworker.0 Request processed in 72us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581457.222118:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581457.222173:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184223616:0@lo:400:kworker.0 00010000:00080000:3.0:1788581457.222223:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43814a80 x1875463184224128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581457.222236:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184224128:0@lo:400:kworker.0 00000100:00100000:2.0:1788581457.233597:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184223744:12345-0@lo:38:kworker.0 Request processed in 12419us (12584us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581457.233619:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788581457.233736:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581457.233744:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581457.233749:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223744:0@lo:38:kworker.0 00010000:00010000:1.0:1788581457.479082:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581457.921549:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788581458.507397:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581458.945376:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788581459.521392:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581459.905988:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581459.969647:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788581460.547762:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581460.993354:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000020:01000004:1.0:1788581461.033416:0:17795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788581461.033420:0:17795:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788581461.033421:0:17795:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788581461.033523:0:17795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e7a4de800 00000020:01000004:1.0:1788581461.033538:0:17795:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788581461.033550:0:17795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788581461.033564:0:17795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff995d42c04d28) 00000020:00000080:1.0:1788581461.033579:0:17795:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788581461.191193:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788581461.206816:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.209604:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.210025:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.210208:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.211031:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.211398:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.211677:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.211858:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.212037:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.212212:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.213016:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.213218:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788581461.213774:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788581461.217169:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.217547:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.218765:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.219161:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.220747:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.221922:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.222394:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.222884:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.223387:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.223717:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.224149:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.224816:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.225107:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.225354:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.225769:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.226074:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.226596:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.228138:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.228771:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.229054:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.229811:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.230088:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.231877:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.232249:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.232888:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.233250:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.233601:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.233785:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.234015:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.234790:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788581461.235416:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788581461.235733:0:17795:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:3.0:1788581461.236480:0:17795:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788581461.236683:0:17795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788581461.236695:0:17795:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581461.236706:0:17795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30d76 00000020:01000004:3.0:1788581461.236713:0:17795:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788581461.236734:0:17795:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788581461.236737:0:17795:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788581461.236742:0:17795:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788581461.236766:0:17795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788581461.236770:0:17795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788581461.248767:0:17795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788581461.248822:0:17795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788581461.248830:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788581461.248832:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788581461.248834:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581461.248835:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581461.248837:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581461.248838:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581461.248839:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581461.248841:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581461.248842:0:17795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581461.248846:0:17795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788581461.248848:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581461.248849:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788581461.248850:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581461.248851:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581461.248853:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581461.248854:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581461.248855:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581461.248856:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581461.248857:0:17795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581461.248882:0:17795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788581461.248901:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581461.249419:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.250668:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4eb7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581461.256990:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224256 00000100:00100000:3.0:1788581461.257006:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224256 00000100:00100000:1.0:1788581461.257296:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581461.257307:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17795:x1875463184224256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581461.257341:0:17056:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788581461.257344:0:17056:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788581461.257351:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788581461.257890:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17795:x1875463184224256:12345-0@lo:253:mount.lustre.0 Request processed in 582us (8469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.257899:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581461.258079:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581461.258093:0:17795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788581461.258104:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581461.258105:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788581461.258106:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581461.258108:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581461.258109:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581461.258110:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581461.258111:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581461.258112:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581461.258113:0:17795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788581461.258131:0:17795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e7a4de800 from lustre-MDT0001 10000000:01000000:0.0:1788581461.258161:0:17795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788581461.258164:0:17795:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788581461.258170:0:17795:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7a7399b8 local copy 00010000:00010000:0.0:1788581461.258182:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581461.258333:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581461.258380:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581461.258412:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.258536:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224384 00000100:00100000:2.0:1788581461.258543:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224384 00000100:00100000:2.0:1788581461.258571:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788581461.258579:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17795:x1875463184224384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581461.258647:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17795:x1875463184224384:12345-0@lo:501:mount.lustre.0 Request processed in 68us (265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581461.258654:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581461.258821:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224384:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788581461.258838:0:17795:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788581461.258855:0:17795:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788581461.258861:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.258869:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581461.258890:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e7a4de800 10000000:01000000:0.0:1788581461.258895:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788581461.258899:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff995e7a7399b8 10000000:01000000:0.0:1788581461.258907:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788581461.258911:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff995e7a7399b8 from 1 10000000:01000000:0.0:1788581461.258914:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788581461.258940:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.258947:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.258955:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581461.258968:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581461.258993:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581461.259022:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.259123:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224512 00000100:00100000:2.0:1788581461.259127:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224512 00000100:00100000:2.0:1788581461.259158:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581461.259165:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+12:17795:x1875463184224512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581461.259183:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581461.259195:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d7d expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.259214:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d7d expref: 13 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.259223:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d7d expref: 13 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.259231:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb45200, rc 0) 00000100:00100000:2.0:1788581461.259294:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+13:17795:x1875463184224512:12345-0@lo:101:mount.lustre.0 Request processed in 130us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.259300:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581461.262134:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581461.262164:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.262176:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581461.262197:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788581461.262276:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.262285:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581461.262295:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e7a4de800 10000000:01000000:0.0:1788581461.262316:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788581461.262321:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e7a4de800 from 1 10000000:01000000:0.0:1788581461.262324:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788581461.262355:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.262362:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.262382:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581461.262400:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581461.262469:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581461.262503:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50bd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.262652:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224640 00000100:00100000:2.0:1788581461.262659:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224640 00000100:00100000:2.0:1788581461.262716:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581461.262726:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+13:17795:x1875463184224640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581461.262738:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581461.262750:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44000/0x50f0cc74b7b30d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d8b expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.262771:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44000/0x50f0cc74b7b30d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d8b expref: 14 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.262780:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44000/0x50f0cc74b7b30d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d8b expref: 14 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.262789:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44000, rc 0) 00000100:00100000:2.0:1788581461.262844:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+14:17795:x1875463184224640:12345-0@lo:101:mount.lustre.0 Request processed in 120us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.262850:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581461.262976:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581461.262989:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.262996:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581461.263006:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788581461.263157:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.263165:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581461.263172:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788581461.263247:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581461.263282:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e7a4de800 10000000:01000000:1.0:1788581461.263288:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788581461.263291:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788581461.263294:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788581461.263321:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.263328:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.263335:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581461.263348:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581461.263389:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.263411:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581461.263905:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224768 00000100:00100000:0.0:1788581461.263912:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224768 00000100:00100000:0.0:1788581461.263951:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581461.263959:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+14:17795:x1875463184224768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581461.263969:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581461.263980:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b30da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30d99 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.264002:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b30da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d99 expref: 15 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.264010:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b30da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d99 expref: 15 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.264017:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70800, rc 0) 00000100:00100000:0.0:1788581461.264059:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184224768:12345-0@lo:101:mount.lustre.0 Request processed in 101us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.264066:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581461.264150:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581461.264163:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.264171:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581461.266785:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788581461.267709:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581461.272038:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788581461.272095:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788581461.272110:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788581461.272122:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788581461.272135:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788581461.272148:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788581461.272165:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788581461.272179:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788581461.272193:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788581461.272222:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788581461.272234:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788581461.272246:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788581461.272284:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788581461.272299:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788581461.272312:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788581461.272324:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788581461.272335:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788581461.272348:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788581461.272361:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788581461.272389:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788581461.272404:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788581461.272418:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788581461.272431:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788581461.272470:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788581461.272477:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788581461.272580:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.272646:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.272751:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581461.273108:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184224896 00000100:00100000:0.0:1788581461.273116:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184224896 00000100:00100000:0.0:1788581461.273210:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581461.273221:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184224896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581461.273414:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184224896:12345-0@lo:501:mount.lustre.0 Request processed in 195us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.273422:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581461.273585:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184224896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.273619:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.273663:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.273755:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581461.273873:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225024 00000100:00100000:3.0:1788581461.273879:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225024 00000100:00100000:3.0:1788581461.273903:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581461.273911:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.274717:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225024:12345-0@lo:503:mount.lustre.0 Request processed in 803us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.274726:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581461.274971:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788581461.275614:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581461.275691:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581461.275745:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581461.275830:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.276308:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225152 00000100:00100000:2.0:1788581461.276316:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225152 00000100:00100000:1.0:1788581461.276409:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788581461.276421:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.277231:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225152:12345-0@lo:502:mount.lustre.0 Request processed in 809us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.277241:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581461.277353:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788581461.277596:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788581461.277631:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788581461.277646:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788581461.277659:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788581461.277672:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788581461.277684:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788581461.277695:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788581461.277707:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788581461.277718:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788581461.277730:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788581461.277742:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788581461.277753:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788581461.277766:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788581461.277776:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788581461.277788:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788581461.277812:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788581461.277827:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788581461.277840:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788581461.277851:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788581461.277873:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788581461.277886:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788581461.277897:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788581461.277909:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788581461.277921:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788581461.277933:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788581461.277944:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788581461.277956:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788581461.277968:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788581461.277993:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788581461.278008:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788581461.278020:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788581461.278032:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788581461.278044:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788581461.278055:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788581461.278067:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788581461.278079:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788581461.278092:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788581461.278106:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788581461.278118:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788581461.278132:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788581461.278145:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788581461.278158:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788581461.278171:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788581461.278184:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788581461.278217:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581461.278290:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581461.278607:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.278858:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225280 00000100:00100000:1.0:1788581461.278865:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225280 00000100:00100000:1.0:1788581461.278895:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581461.278903:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.279016:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184225280:12345-0@lo:502:mount.lustre.0 Request processed in 112us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.279023:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581461.279154:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184225280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788581461.279209:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788581461.279219:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788581461.279964:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581461.279973:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.279976:0:17799:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788581461.280052:0:17799:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788581461.280057:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581461.280071:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff995d41c019b8) 00000020:00000080:3.0:1788581461.280090:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788581461.280096:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581461.280174:0:17799:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581461.280181:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30dae 00000020:00000080:1.0:1788581461.280898:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788581461.280904:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.280909:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.280910:0:17799:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788581461.280915:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.280919:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.280920:0:17799:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788581461.280924:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581461.280935:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff995d42c00000) 00000020:00000080:1.0:1788581461.280949:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788581461.280953:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788581461.280955:0:17799:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788581461.280958:0:17799:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788581461.280964:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581461.281111:0:17799:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7a4de800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788581461.281125:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff995d42c019b8) 00000020:00000080:1.0:1788581461.281134:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788581461.281180:0:17799:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788581461.281186:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30dc3 00000020:00000080:1.0:1788581461.281350:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788581461.281372:0:17799:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788581461.281377:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x50f0cc74b7b30dca 00080000:01000000:1.0:1788581461.281384:0:17799:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788581461.281388:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30dd1 00010000:00010000:3.0:1788581461.389580:0:17799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788581461.390251:0:17799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788581461.392140:0:17799:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788581461.406094:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788581461.406112:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.406122:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.406125:0:17799:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788581461.406128:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.406134:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.406135:0:17799:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788581461.406138:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581461.406144:0:17799:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1788581461.406173:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581461.406193:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff995e478719b8) 00000020:00000080:1.0:1788581461.406218:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788581461.406224:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581461.406320:0:17799:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788581461.406327:0:17799:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788581461.406338:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30ddf 00010000:00080000:1.0:1788581461.406383:0:17799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7fa8e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581461.409200:0:17799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788581461.423999:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581461.424021:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788581461.424087:0:17799:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788581461.424119:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30de6 00000100:00080000:0.0:1788581461.424148:0:17799:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581461.424156:0:17799:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e7fa8e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581461.424206:0:17799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a1500 x1875463184225408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581461.424388:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184225408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788581461.424484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581461.424601:0:17799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788581461.424673:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581461.424678:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424679:0:17799:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788581461.424683:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788581461.424686:0:17799:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788581461.424688:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581461.424689:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581461.424691:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788581461.424693:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424695:0:17799:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788581461.424697:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581461.424714:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424716:0:17799:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788581461.424721:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788581461.424759:0:17799:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788581461.424771:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581461.424774:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424775:0:17799:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788581461.424778:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788581461.424780:0:17799:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788581461.424781:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581461.424782:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581461.424784:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788581461.424786:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424788:0:17799:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788581461.424790:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581461.424793:0:17799:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788581461.424797:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581461.424805:0:17799:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788581461.424810:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788581461.424814:0:17799:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1788581461.424839:0:17799:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788581461.424842:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581461.424858:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff995e7fa03370) 00000020:00000080:0.0:1788581461.424873:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788581461.424884:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788581461.424955:0:17799:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788581461.424963:0:17799:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788581461.424970:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30df4 00010000:00080000:0.0:1788581461.425005:0:17799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7fa8b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00000100:00100000:2.0:1788581461.425165:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225408 00000100:00100000:2.0:1788581461.425175:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225408 00000100:00100000:2.0:1788581461.425212:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581461.425221:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184225408:12345-0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788581461.425245:0:17799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00010000:00080000:2.0:1788581461.425277:0:17069:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1788581461.425313:0:17069:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30dfb 00000004:00100000:2.0:1788581461.425331:0:17069:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788581461.425338:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1788581461.426390:0:17799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788581461.426592:0:17799:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788581461.426832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788581461.426839:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788581461.426845:0:36:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581461.426854:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788581461.426861:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788581461.426868:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995d43bf2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581461.426924:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43bb5f80 x1875463184225536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1788581461.428381:0:17799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581461.428878:0:17799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788581461.429048:0:17799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1788581461.429398:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184225536:0@lo:38:kworker.0 00000100:00100000:3.0:1788581461.429494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788581461.429682:0:17804:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581461.429687:0:17804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788581461.429984:0:17068:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788581461.429995:0:17068:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788581461.430244:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225536 00000100:00100000:1.0:1788581461.430277:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225536 00000100:00100000:3.0:1788581461.430464:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581461.430473:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184225536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788581461.430566:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184225536:12345-0@lo:38:kworker.0 Request processed in 91us (1071us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581461.430573:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581461.431165:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581461.431180:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581461.431186:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788581461.431191:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184225536:0@lo:38:kworker.0 00000020:00000080:1.0:1788581461.432180:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788581461.432212:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788581461.433916:0:17799:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788581461.433961:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30e02 00000100:00080000:1.0:1788581461.433976:0:17799:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581461.433984:0:17799:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e7fa8b800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581461.434035:0:17799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d4339ce00 x1875463184225664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581461.434169:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184225664:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788581461.434243:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184225664 offset 0 length 520: 4 00000100:00080000:2.0:1788581461.434908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.434915:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581461.434918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.434921:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581461.435625:0:17799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788581461.435753:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184225792:0@lo:400:kworker.0 00000100:00100000:3.0:1788581461.435843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581461.435905:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225792 00000100:00100000:3.0:1788581461.435925:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225792 00000100:00100000:3.0:1788581461.435984:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581461.435994:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184225792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581461.436056:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184225792:12345-0@lo:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.436065:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581461.436116:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43bb4700 x1875463184225792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581461.436133:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184225792:0@lo:400:kworker.0 00000020:01000000:1.0:1788581461.436308:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.436317:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.436319:0:17799:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788581461.436323:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788581461.436327:0:17799:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788581461.436330:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581461.436332:0:17799:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581461.436333:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788581461.436336:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.436337:0:17799:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788581461.436339:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581461.436346:0:17799:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788581461.436349:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.436351:0:17799:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788581461.436354:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581461.436358:0:17799:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1788581461.436399:0:17799:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788581461.436403:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581461.436423:0:17799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff995e47873370) 00000020:00000080:1.0:1788581461.436450:0:17799:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788581461.436455:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581461.436591:0:17799:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788581461.436600:0:17799:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788581461.436614:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b30e10 00010000:00080000:1.0:1788581461.436651:0:17799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d43a55000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581461.436918:0:17799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788581461.437014:0:17799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581461.437036:0:17799:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788581461.438857:0:17069:0:(import.c:65:import_set_state_nolock()) ffff995d43a52800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581461.438985:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184225408:12345-0@lo:38:llog_process_th.0 Request processed in 13759us (14496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.438997:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581461.439069:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581461.439081:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788581461.439091:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788581461.439097:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581461.439101:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581461.439113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184225408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788581461.439943:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184225920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581461.440011:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.440124:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184225920 00000100:00100000:1.0:1788581461.440133:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184225920 00000100:00100000:1.0:1788581461.440940:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581461.440956:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184225920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581461.441001:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788581461.441078:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184225920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.441085:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581461.441409:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184225920:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788581461.442095:0:17799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581461.442443:0:17799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788581461.442631:0:17799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788581461.443121:0:17807:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581461.443127:0:17807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:2.0:1788581461.443458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.443464:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581461.443467:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.443471:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1788581461.444223:0:17799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581461.444240:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788581461.446202:0:17799:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788581461.446247:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30e17 00000100:00080000:3.0:1788581461.446596:0:17799:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581461.446605:0:17799:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d43a55000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581461.446658:0:17799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43816a00 x1875463184226048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581461.446740:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184226048:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788581461.446828:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184226048 offset 0 length 520: 4 00000100:00080000:3.0:1788581461.447016:0:17799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788581461.447179:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581461.447187:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.447190:0:17799:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788581461.447193:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581461.447197:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.447198:0:17799:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581461.447201:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581461.447204:0:17799:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581461.447206:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581461.447208:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.447217:0:17799:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788581461.447221:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581461.447224:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.447225:0:17799:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581461.447229:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788581461.447289:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581461.447293:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581461.447295:0:17799:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581461.447298:0:17799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788581461.447569:0:17795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788581461.447607:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788581461.447638:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.447651:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581461.447662:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7a4de800 from 1 10000000:01000000:1.0:1788581461.447665:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581461.447768:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.447777:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.447789:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581461.447892:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581461.447961:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.448003:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581461.448085:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226176 00000100:00100000:0.0:1788581461.448094:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226176 00000100:00100000:0.0:1788581461.448152:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581461.448163:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+15:17795:x1875463184226176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581461.448178:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581461.448195:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e1e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.448236:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 16 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.448249:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 16 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581461.448284:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71200, rc 0) 00000100:00100000:0.0:1788581461.448334:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17795:x1875463184226176:12345-0@lo:101:mount.lustre.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.448342:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581461.448471:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581461.448490:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.448500:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581461.449242:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226304:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788581461.449360:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581461.449996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.450003:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581461.450007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.450011:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581461.451564:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.454390:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226304 00000100:00100000:2.0:1788581461.454406:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226304 00000100:00100000:2.0:1788581461.454475:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581461.454486:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17795:x1875463184226304:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788581461.454514:0:17057:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788581461.454921:0:17057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788581461.454931:0:17057:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788581461.455129:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17795:x1875463184226304:12345-0@lo:256:mount.lustre.0 Request processed in 641us (5765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.455143:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581461.455342:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226304:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788581461.456088:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581461.456117:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.456131:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581461.456141:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7a4de800 from 1 10000000:01000000:1.0:1788581461.456145:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581461.456190:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.456198:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.456208:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581461.456234:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581461.456329:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.456401:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.456425:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226432 00000100:00100000:2.0:1788581461.456439:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226432 00000100:00100000:2.0:1788581461.456499:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581461.456508:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17795:x1875463184226432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581461.456535:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581461.456555:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e2c expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581461.460658:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581461.460683:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581461.460696:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44600, rc 0) 00000100:00100000:3.0:1788581461.460832:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226432:12345-0@lo:101:mount.lustre.0 Request processed in 4323us (4501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.460842:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581461.462032:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581461.462066:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.462079:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581461.462328:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581461.462399:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.462468:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.462518:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581461.462697:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226560 00000100:00100000:3.0:1788581461.462716:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226560 00000100:00100000:3.0:1788581461.462826:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581461.462838:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581461.462963:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226560:12345-0@lo:501:mount.lustre.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.462984:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581461.463063:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.463097:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.463139:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581461.465383:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226688 00000100:00100000:0.0:1788581461.465404:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226688 00000100:00100000:0.0:1788581461.465473:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581461.465486:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.465809:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.466489:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581461.467231:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581461.467411:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226688:12345-0@lo:503:mount.lustre.0 Request processed in 1923us (4265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.467424:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581461.467908:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.467987:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.468088:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581461.468132:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226816 00000100:00100000:3.0:1788581461.468140:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226816 00000100:00100000:3.0:1788581461.468229:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581461.468240:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581461.468458:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226816:12345-0@lo:502:mount.lustre.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.468466:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581461.468592:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581461.468880:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788581461.468917:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788581461.468945:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788581461.468962:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788581461.468976:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788581461.468989:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788581461.469001:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788581461.469014:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788581461.469028:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788581461.469042:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788581461.469056:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788581461.469097:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.469145:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.469739:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581461.469880:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184226944 00000100:00100000:3.0:1788581461.469891:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184226944 00000100:00100000:3.0:1788581461.469940:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581461.469950:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581461.470101:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184226944:12345-0@lo:502:mount.lustre.0 Request processed in 150us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.470109:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581461.470231:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184226944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581461.470330:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788581461.470343:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788581461.471406:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.471421:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471424:0:17809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788581461.471432:0:17809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7a4de800 00000020:00000080:1.0:1788581461.471435:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581461.471446:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.471449:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471450:0:17809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788581461.471452:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.471454:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471456:0:17809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581461.471459:0:17809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7a4de800 00000020:00000080:1.0:1788581461.471460:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581461.471550:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.471555:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471557:0:17809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788581461.471559:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.471562:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471563:0:17809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581461.471567:0:17809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7a4de800 00000020:00000080:1.0:1788581461.471570:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581461.471590:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.471593:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471594:0:17809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581461.471597:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581461.471613:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471615:0:17809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788581461.471620:0:17809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7a4de800 00000020:00000080:1.0:1788581461.471622:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581461.471646:0:17809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581461.471649:0:17809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581461.471650:0:17809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788581461.471653:0:17809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788581461.471721:0:17795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581461.471750:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581461.471771:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.471783:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581461.473566:0:17795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581461.473578:0:17795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e7a4de800 10000000:01000000:1.0:1788581461.473582:0:17795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e7a4de800 10000000:01000000:1.0:1788581461.473587:0:17795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581461.473597:0:17795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e7a4de800 from 1 10000000:01000000:1.0:1788581461.473600:0:17795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581461.473655:0:17795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.473669:0:17795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.473681:0:17795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581461.473885:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581461.474003:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.474069:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227072 00000100:00100000:1.0:1788581461.474077:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227072 00000100:00100000:1.0:1788581461.474127:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581461.474138:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17795:x1875463184227072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581461.474155:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581461.474171:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b30e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e3a expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.474200:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b30e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e3a expref: 18 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.474211:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b30e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e3a expref: 18 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.474222:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5400, rc 0) 00000100:00100000:1.0:1788581461.474294:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227072:12345-0@lo:101:mount.lustre.0 Request processed in 157us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.474302:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581461.474353:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.474393:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581461.474411:0:17795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.474422:0:17795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581461.481473:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788581461.482017:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581461.482299:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788581461.482328:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788581461.482342:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788581461.482356:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788581461.482381:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788581461.482396:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788581461.482411:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788581461.482424:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788581461.482443:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788581461.482566:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788581461.482584:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788581461.482598:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788581461.482609:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788581461.482622:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788581461.482635:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788581461.482648:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788581461.482676:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788581461.482690:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788581461.482782:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788581461.482879:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788581461.482897:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788581461.482910:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788581461.482923:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788581461.482937:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788581461.482949:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788581461.482961:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788581461.482974:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788581461.482987:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788581461.483011:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788581461.483017:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788581461.483135:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.483238:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.483332:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581461.483444:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227200 00000100:00100000:0.0:1788581461.483454:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227200 00000100:00100000:0.0:1788581461.483512:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788581461.483524:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581461.483681:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227200:12345-0@lo:501:mount.lustre.0 Request processed in 159us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.483689:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581461.483942:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581461.483986:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.484039:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.484065:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.484083:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227328 00000100:00100000:1.0:1788581461.484087:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227328 00000100:00100000:1.0:1788581461.484124:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581461.484131:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581461.484221:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227328:12345-0@lo:503:mount.lustre.0 Request processed in 89us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.484228:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581461.484295:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581461.484923:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581461.485009:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.485068:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.485108:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227456 00000100:00100000:1.0:1788581461.485114:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227456 00000100:00100000:1.0:1788581461.485163:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581461.485172:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.485301:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227456:12345-0@lo:502:mount.lustre.0 Request processed in 130us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.485308:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581461.485351:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.485388:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581461.485585:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788581461.485612:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788581461.485626:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788581461.485638:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788581461.485651:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788581461.485663:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788581461.485676:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788581461.485688:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788581461.486384:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788581461.486421:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788581461.486436:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788581461.486449:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788581461.486462:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788581461.486476:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788581461.486489:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788581461.486501:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788581461.486515:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788581461.486545:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788581461.486558:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788581461.486572:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788581461.486585:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788581461.486598:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788581461.486611:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788581461.486626:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788581461.486639:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788581461.486652:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788581461.486665:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788581461.486679:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788581461.486692:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788581461.487341:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788581461.487377:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788581461.487404:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788581461.487417:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788581461.487448:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788581461.487465:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788581461.487479:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788581461.487492:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788581461.487506:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788581461.487520:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788581461.487534:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788581461.487548:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788581461.487560:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788581461.487574:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788581461.487587:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788581461.487599:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788581461.487613:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788581461.487628:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788581461.487642:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788581461.488445:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.488555:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.488610:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227584 00000100:00100000:1.0:1788581461.488621:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227584 00000100:00100000:1.0:1788581461.488676:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788581461.488687:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.489358:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227584:12345-0@lo:502:mount.lustre.0 Request processed in 670us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.489380:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788581461.489452:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.489481:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581461.489748:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788581461.489788:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788581461.490041:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581461.490095:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.490138:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.490202:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227712 00000100:00100000:2.0:1788581461.490211:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227712 00000100:00100000:2.0:1788581461.490303:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581461.490314:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581461.490434:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227712:12345-0@lo:502:mount.lustre.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.490442:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788581461.490615:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581461.490679:0:17795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788581461.490690:0:17795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788581461.500557:0:17812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788581461.500582:0:17812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff995e7a690000) 00000020:00000080:2.0:1788581461.500614:0:17812:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788581461.500881:0:17812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7a4de800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788581461.500886:0:17812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7a4de800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788581461.500889:0:17812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7a4de800 3 00010000:00080000:2.0:1788581461.500934:0:17812:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e44e1c000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581461.509507:0:17812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788581461.521228:0:17812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788581461.521310:0:17812:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788581461.521329:0:17812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x50f0cc74b7b30e4f 00000100:00080000:2.0:1788581461.521343:0:17812:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581461.521350:0:17812:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995e44e1c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581461.523423:0:17812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43bb5180 x1875463184227840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581461.523476:0:17812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581461.523520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.523526:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581461.523541:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581461.523545:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581461.524448:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184227840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581461.524553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.526663:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227840 00000100:00100000:2.0:1788581461.526682:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227840 00000100:00100000:2.0:1788581461.526753:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581461.526764:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184227840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788581461.526933:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1788581461.527000:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x50f0cc74b7b30e56 00000004:00100000:2.0:1788581461.527021:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788581461.527061:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995e4f108800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581461.527182:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875463184227840:12345-0@lo:38:llog_process_th.0 Request processed in 418us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.527190:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788581461.527381:0:17812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:0.0:1788581461.527645:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43bb5180 x1875463184227840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581461.527678:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581461.527689:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788581461.527769:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788581461.527775:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788581461.527779:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581461.527786:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184227840:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788581461.528474:0:17795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788581461.528520:0:17795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581461.528541:0:17795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.528554:0:17795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581461.528623:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581461.528626:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581461.528627:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581461.528628:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581461.528630:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581461.528631:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581461.528633:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581461.528636:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581461.528637:0:17795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581461.528642:0:17795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788581461.528644:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581461.528646:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581461.528647:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581461.528648:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581461.528649:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581461.528655:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581461.528656:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581461.528657:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581461.528658:0:17795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581461.528687:0:17795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788581461.529101:0:17795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788581461.529193:0:17795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581461.529242:0:17795:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42134a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.529450:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184227968 00000100:00100000:1.0:1788581461.529459:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184227968 00000100:00100000:1.0:1788581461.529517:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581461.529527:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581461.529560:0:17056:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788581461.529575:0:17056:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788581461.535874:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788581461.536391:0:17056:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788581461.539799:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788581461.540295:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17795:x1875463184227968:12345-0@lo:253:mount.lustre.0 Request processed in 10762us (11095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581461.540310:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581461.540465:0:17795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:17795:1875463184227968:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581461.540483:0:17795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788581461.540488:0:17795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581461.540489:0:17795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581461.540491:0:17795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581461.540492:0:17795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581461.540494:0:17795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581461.540496:0:17795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581461.540498:0:17795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581461.540500:0:17795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581461.540501:0:17795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788581461.540519:0:17795:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788581461.542964:0:17079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581461.542977:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788581461.543081:0:17079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543105:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543113:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543121:0:17079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543176:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543215:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 17 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581461.543234:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184228096:0@lo:104: 00000100:00100000:2.0:1788581461.543350:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581461.543431:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543440:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 17 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581461.543449:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184228224:0@lo:104: 00000100:00100000:2.0:1788581461.543469:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.543511:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228096 00000100:00100000:2.0:1788581461.543520:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228096 00000100:00100000:2.0:1788581461.543568:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228224 00000100:00100000:2.0:1788581461.543572:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228224 00000100:00100000:2.0:1788581461.543589:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581461.543599:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184228096:12345-0@lo:104: 00010000:00010000:2.0:1788581461.543614:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.543671:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581461.543678:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184228096:12345-0@lo:104: Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.543685:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581461.543823:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581461.543833:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184228224:12345-0@lo:104: 00010000:00010000:3.0:1788581461.543842:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581461.543879:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581461.543884:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184228224:12345-0@lo:104: Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581461.543889:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788581461.544869:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581461.544880:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.544905:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581461.544910:0:17051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.544920:0:17051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581461.544929:0:17051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581461.544934:0:17051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581461.544994:0:17051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545000:0:17051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581461.545034:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545042:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5000/0x50f0cc74b7b30e1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e25 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545061:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581461.545065:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545072:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581461.545075:0:17051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545093:0:17051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581461.545100:0:17051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581461.545105:0:17051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581461.545119:0:17051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545125:0:17051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581461.545142:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545149:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f980200/0x50f0cc74b7b30d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d61 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545164:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581461.545165:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581461.545167:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581461.545177:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581461.545194:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184228352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581461.545271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.545329:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184228480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581461.545355:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.545412:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228352 00000100:00100000:2.0:1788581461.545421:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228352 00010000:00010000:2.0:1788581461.545449:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 18 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581461.545488:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228480 00000100:00100000:2.0:1788581461.545492:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228480 00010000:00010000:2.0:1788581461.545505:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 19 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581461.545518:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581461.545527:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3618:x1875463184228352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581461.545540:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581461.545545:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 19 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545557:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 19 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545575:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581461.545610:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3618:x1875463184228352:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.545617:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581461.545634:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581461.545640:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3620:x1875463184228480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581461.545648:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581461.545652:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 18 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545660:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 18 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545671:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.545686:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581461.546360:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4540 going to sleep for 11 seconds 00010000:00010000:3.0:1788581461.546407:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa71200/0x50f0cc74b7b30e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e1e expref: 18 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581461.546421:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184228096:0@lo:104: 00010000:00010000:3.0:1788581461.546434:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30d5a expref: 17 pid: 17058 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581461.546442:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184228224:0@lo:104: 00010000:00010000:3.0:1788581461.546467:0:17079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581461.547917:0:17048:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004939741s 00010000:00010000:2.0:1788581461.547935:0:17048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.547946:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.547955:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.547962:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.547969:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581461.547974:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.547982:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581461.553469:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788581461.558335:0:17795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788581461.558466:0:17820:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788581461.558471:0:17820:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788581461.558634:0:17079:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581461.558651:0:17079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581461.560180:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184228352:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788581461.562537:0:17821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788581461.562984:0:17795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788581461.563384:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:2.0:1788581461.564591:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.564616:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45000/0x50f0cc74b7b30e5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581461.564653:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581461.565161:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+16:3620:x1875463184228480:12345-0@lo:103:ldlm_bl.0 Request processed in 19514us (19799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.565180:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581461.565248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184228480:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788581461.565526:0:17795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788581461.565578:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581461.567219:0:17822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228608:0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1788581461.569424:0:17795:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788581461.569452:0:17795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788581461.569590:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581461.571458:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788581461.571570:0:17821:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00010000:2.0:1788581461.572045:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581461.572123:0:17822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.572183:0:17822:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.572221:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228608 00000100:00100000:1.0:1788581461.572232:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228608 00000100:00100000:1.0:1788581461.572622:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581461.572634:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788581461.572749:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.572757:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581461.573949:0:17822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228608:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788581461.574014:0:17822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788581461.574083:0:17822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.574159:0:17822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.574199:0:17822:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.574679:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228736 00000100:00100000:1.0:1788581461.574693:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228736 00000100:00100000:1.0:1788581461.574752:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581461.574763:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228736:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788581461.575496:0:17795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788581461.575563:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 797us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.575574:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581461.575953:0:17822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.576220:0:17822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17822:1875463184228864:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.576301:0:17822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.576341:0:17822:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581461.576479:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228864 00000100:00100000:1.0:1788581461.576491:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228864 00000100:00100000:1.0:1788581461.576542:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581461.576550:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17822:x1875463184228864:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788581461.576622:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17822:x1875463184228864:12345-0@lo:900:lod0001_rec0000.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581461.576628:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788581461.577237:0:17795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00080000:2.0:1788581461.577393:0:17822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43bb4700 x1875463184228864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581461.577407:0:17822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17822:1875463184228864:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.577490:0:17822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.577544:0:17822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581461.577586:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184228992 00000100:00100000:2.0:1788581461.577592:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184228992 00000100:00100000:2.0:1788581461.577664:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581461.577674:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228992:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788581461.577997:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17822:x1875463184228992:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 324us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581461.578006:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581461.578031:0:17822:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581461.578045:0:17822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17822:1875463184228992:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788581461.578115:0:17822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788581461.580304:0:17795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788581461.580536:0:17795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788581461.585246:0:17795:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:2.0:1788581461.586238:0:17822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581461.586349:0:17822:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788581461.586355:0:17822:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788581461.592244:0:17795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788581461.612509:0:17795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581461.612570:0:17795:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffabf141607988 00100000:10000000:3.0:1788581461.612581:0:17795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788581461.613992:0:17795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581461.614032:0:17795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581461.615009:0:17795:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788581461.615044:0:17795:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788581461.618714:0:17795:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581461.619026:0:17795:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788581462.017463:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000040:00080000:1.0:1788581462.593906:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581462.594019:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581463.041374:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 10000000:01000000:3.0:1788581463.233891:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581463.233899:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7a4de800 from 8 10000000:01000000:3.0:1788581463.233903:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581463.233950:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.233960:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.233970:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581463.233993:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581463.234070:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581463.234142:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581463.234147:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229120 00000100:00100000:1.0:1788581463.234156:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229120 00000100:00100000:1.0:1788581463.234207:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581463.234228:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17060:x1875463184229120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581463.234241:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581463.234291:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e64 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.234315:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.234325:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.234334:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4c00, rc 0) 00000100:00100000:1.0:1788581463.234401:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184229120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581463.234409:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788581463.234683:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581463.234698:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.234708:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581463.234777:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581463.234825:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581463.234856:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581463.235008:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229248 00000100:00100000:0.0:1788581463.235014:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229248 00000100:00100000:0.0:1788581463.235052:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581463.235068:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184229248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788581463.235088:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581463.235105:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581463.235108:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788581463.235201:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184229248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581463.235211:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788581463.235277:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581463.235285:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581463.235289:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788581463.235299:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581463.235309:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581463.235312:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3d800 from 8 10000000:01000000:3.0:1788581463.235315:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581463.235333:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.235341:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.235348:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581463.235371:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581463.235397:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581463.235427:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581463.236446:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229376 00000100:00100000:1.0:1788581463.236456:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229376 00000100:00100000:1.0:1788581463.236510:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581463.236519:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184229376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581463.236531:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581463.236546:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e72 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.236567:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.236589:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581463.236597:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5600, rc 0) 00000100:00100000:1.0:1788581463.236655:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184229376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581463.236662:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788581463.236819:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581463.236834:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.236854:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581463.236907:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581463.236940:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581463.236974:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81fec840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581463.236990:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229504 00000100:00100000:0.0:1788581463.236996:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229504 00000100:00100000:0.0:1788581463.237081:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581463.237090:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184229504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788581463.237112:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581463.237127:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581463.237130:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788581463.237226:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184229504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581463.237233:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788581463.237338:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184229504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788581463.237389:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581463.237396:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581463.237403:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581463.617952:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788581463.619718:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581464.065682:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788581464.641720:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581465.089667:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788581465.667430:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581466.117939:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 0 seconds 00000001:02000400:2.0:1788581466.458143:0:18066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788581466.689465:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581466.953268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581466.953274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788581466.953278:0:36:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581466.953288:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995d43bf2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581466.953298:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581466.953315:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184229632:0@lo:400:kworker.0 00000100:00100000:3.0:1788581466.953439:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581466.953523:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229632 00000100:00100000:3.0:1788581466.953531:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229632 00000100:00100000:3.0:1788581466.953574:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788581466.953582:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3620:x1875463184229632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581466.953630:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3620:x1875463184229632:12345-0@lo:400:kworker.0 Request processed in 48us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581466.953638:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788581466.953686:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184229632:0@lo:400:kworker.0 00000100:00100000:3.0:1788581466.953723:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817480 x1875463184229760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581466.953741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581466.953745:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581466.953748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581466.953751:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581466.953762:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184229760:0@lo:38:kworker.0 00000100:00100000:3.0:1788581466.953806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581466.953839:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229760 00000100:00100000:3.0:1788581466.953842:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229760 00000100:00100000:3.0:1788581466.953861:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581466.953866:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184229760:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788581466.953890:0:17069:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788581466.953926:0:17069:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30e80 00000004:00100000:3.0:1788581466.953943:0:17069:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788581466.953950:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788581466.954047:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184229888:0@lo:400:kworker.0 00000100:00100000:3.0:1788581466.954076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581466.960564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581466.960570:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581466.960573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581466.960576:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581466.960584:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581466.960602:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.960662:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581466.960702:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230144 00000100:00100000:2.0:1788581466.960708:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230144 00000100:00100000:2.0:1788581466.960744:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581466.960752:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.960810:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184230144:12345-0@lo:400:kworker.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581466.960817:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581466.960850:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.960878:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184230272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.960899:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581466.960918:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184229888 00000100:00100000:2.0:1788581466.960921:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184229888 00000100:00100000:2.0:1788581466.960939:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230272 00000100:00100000:2.0:1788581466.960941:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230272 00000100:00100000:2.0:1788581466.960952:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581466.960957:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.960986:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184229888:12345-0@lo:400:kworker.0 Request processed in 29us (6910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581466.960992:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581466.961001:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581466.961005:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184230272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581466.961026:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184230272:12345-0@lo:400:kworker.0 Request processed in 21us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581466.961032:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788581466.961052:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43bb4700 x1875463184230272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581466.961063:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184230272:0@lo:400:kworker.0 00010000:00080000:3.0:1788581466.961296:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43814000 x1875463184229888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581466.961306:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184229888:0@lo:400:kworker.0 00000100:00100000:3.0:1788581466.961316:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581466.961322:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184230016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581466.961359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581466.961387:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230016 00000100:00100000:3.0:1788581466.961390:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230016 00000100:00100000:3.0:1788581466.961410:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581466.961415:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184230016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581466.961437:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788581466.961473:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184230016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581466.961478:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581466.961516:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184230016:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788581466.977507:0:17069:0:(import.c:65:import_set_state_nolock()) ffff995e7fa35000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581466.977605:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184229760:12345-0@lo:38:kworker.0 Request processed in 23735us (23796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581466.977615:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788581466.978474:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788581466.978486:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788581466.978514:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788581466.978517:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788581466.978585:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d7971f99): req@ffff995d43bb4e00 x1875463184222848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581466.978608:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184229760:0@lo:38:kworker.0 00000100:00100000:1.0:1788581466.978716:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581466.978731:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184230400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581466.978786:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581466.978831:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230400 00000100:00100000:1.0:1788581466.978837:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230400 00000100:00100000:1.0:1788581466.978872:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581466.978880:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184230400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581466.978904:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581466.978937:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184230400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581466.978943:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581466.978973:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184230400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581466.980042:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581466.980077:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f290a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581466.980126:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184222848 00000100:00100000:0.0:1788581466.980133:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184222848 00000100:00100000:0.0:1788581466.980176:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581466.980185:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184222848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788581466.980297:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184222848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581466.980305:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581466.980482:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17105:1875463184222848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788581466.980515:0:17105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788581466.980552:0:17105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17105:1875463184230528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581466.980582:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581466.980614:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581466.980651:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230528 00000100:00100000:1.0:1788581466.980655:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230528 00000100:00100000:1.0:1788581466.980685:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581466.980691:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184230528:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788581466.980807:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184230528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581466.980829:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581466.980946:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17105:1875463184230528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581466.981008:0:17105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17105:1875463184230656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581466.981032:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581466.981055:0:17105:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581466.981109:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230656 00000100:00100000:1.0:1788581466.981114:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230656 00000100:00100000:1.0:1788581466.981151:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581466.981158:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184230656:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788581466.981216:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17105:x1875463184230656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581466.981222:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581466.981247:0:17105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17105:1875463184230656:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788581466.981316:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581466.983393:0:17105:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788581466.983476:0:17105:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788581466.983481:0:17105:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788581467.594888:0:18118:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581467.595102:0:18118:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788581467.714563:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788581468.496457:0:18168:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581468.496692:0:18168:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788581468.737553:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581469.129501:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788581469.509101:0:18216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa1bd8a80 20000000:00000080:0.0:1788581469.509116:0:18216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e44939000 uarg=0000000000000000 20000000:01000000:0.0:1788581469.509153:0:18216:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788581469.509161:0:18216:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788581469.509165:0:18216:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788581469.510605:0:18218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788581469.512283:0:18216:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788581469.528688:0:18216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581469.530770:0:18216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.530795:0:18216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.530803:0:18216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.530824:0:18216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.530868:0:18216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.530883:0:18216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.530898:0:18216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18216:1875463184230784:0@lo:104: 00000100:00100000:2.0:1788581469.531013:0:18216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581469.531077:0:18216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531086:0:18216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 17 pid: 17058 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.531095:0:18216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44073b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18216:1875463184230912:0@lo:104: 00000100:00100000:2.0:1788581469.531117:0:18216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581469.531148:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230784 00000100:00100000:2.0:1788581469.531155:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230784 00000100:00100000:2.0:1788581469.531189:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184230912 00000100:00100000:2.0:1788581469.531192:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184230912 00000100:00100000:2.0:1788581469.531205:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581469.531213:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+4:18216:x1875463184230784:12345-0@lo:104: 00010000:00010000:2.0:1788581469.531225:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531297:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581469.531309:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+4:18216:x1875463184230784:12345-0@lo:104: Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581469.531338:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581469.531356:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581469.531362:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:18216:x1875463184230912:12345-0@lo:104: 00010000:00010000:2.0:1788581469.531371:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531416:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581469.531421:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:18216:x1875463184230912:12345-0@lo:104: Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581469.531427:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788581469.531443:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581469.531448:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531454:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581469.531459:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531466:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581469.531473:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581469.531478:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581469.531506:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531521:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581469.531542:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531549:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4400/0x50f0cc74b7b30e2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e33 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531561:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581469.531565:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531570:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581469.531573:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531579:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581469.531585:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581469.531589:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581469.531602:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531607:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581469.531621:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531627:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f980a00/0x50f0cc74b7b30d29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30d30 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531646:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581469.531648:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581469.531649:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581469.531657:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581469.531669:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184231040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581469.531695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581469.531719:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581469.531726:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184231168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581469.531746:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581469.531769:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231040 00000100:00100000:2.0:1788581469.531787:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231040 00010000:00010000:2.0:1788581469.531804:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 18 pid: 17056 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.531823:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231168 00000100:00100000:2.0:1788581469.531826:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231168 00010000:00010000:2.0:1788581469.531836:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 19 pid: 17058 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.531847:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581469.531853:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3618:x1875463184231040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581469.531862:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581469.531866:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 19 pid: 17056 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531875:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 19 pid: 17056 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531901:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581469.531929:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3618:x1875463184231040:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581469.531936:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581469.531949:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581469.531955:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3621:x1875463184231168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581469.531962:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581469.531966:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 18 pid: 17058 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531974:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 18 pid: 17058 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531986:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.531993:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532005:0:17048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532013:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532020:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532025:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532036:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581469.532040:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532046:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532053:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532062:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581469.532088:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3621:x1875463184231168:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581469.532095:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581469.532175:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184231168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581469.532198:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184231040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581469.532213:0:18216:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478bb000 going to sleep for 11 seconds 00010000:00010000:2.0:1788581469.532224:0:18216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b30e33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e2c expref: 17 pid: 17056 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.532234:0:18216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18216:1875463184230784:0@lo:104: 00010000:00010000:2.0:1788581469.532244:0:18216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b30d30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30d29 expref: 16 pid: 17058 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581469.532251:0:18216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44073b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18216:1875463184230912:0@lo:104: 00010000:00010000:2.0:1788581469.532281:0:18216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532300:0:18216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532307:0:18216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581469.532324:0:18216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45400/0x50f0cc74b7b30e87 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581469.536230:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581469.761632:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581470.786377:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581471.043141:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581461/real 1788581461] req@ffff995d43816a00 x1875463184226048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581471.043173:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43816a00 x1875463184226048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581471.043243:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581461/real 1788581461] req@ffff995d4339ce00 x1875463184225664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581471.043285:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d4339ce00 x1875463184225664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581471.043312:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581471.043455:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581471.043460:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184226048:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788581471.043466:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788581471.043805:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184231296:0@lo:400:kworker.0 00000100:00100000:3.0:1788581471.043866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581471.043953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581471.043962:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581471.043965:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581471.043967:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581471.044024:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231296 00000100:00100000:0.0:1788581471.044032:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231296 00000100:00100000:0.0:1788581471.044089:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581471.044098:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+16:3621:x1875463184231296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788581471.048672:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581471.048684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184225664:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788581471.048737:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184231424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.048821:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581471.048868:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581471.048875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184231552:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.048901:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581471.048930:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231552 00000100:00100000:2.0:1788581471.048937:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231552 00000100:00100000:2.0:1788581471.048980:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581471.048988:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184231552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049042:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184231552:12345-0@lo:400:kworker.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581471.049049:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788581471.049088:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d4339dc00 x1875463184231552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581471.049101:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184231552:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049158:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184231680:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049182:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581471.049212:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231424 00000100:00100000:2.0:1788581471.049216:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231424 00000100:00100000:2.0:1788581471.049235:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184231680 00000100:00100000:2.0:1788581471.049238:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184231680 00000100:00100000:2.0:1788581471.049249:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581471.049279:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184231424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049328:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184231424:12345-0@lo:400:kworker.0 Request processed in 73us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581471.049334:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581471.049345:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581471.049360:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184231680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049392:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184231680:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581471.049397:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581471.049422:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184231424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.049445:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184231680:0@lo:400:kworker.0 00000100:00080000:1.0:1788581471.051717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581471.051726:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788581471.051730:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581471.051738:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:1.0:1788581471.051758:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788581471.051765:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e7fa8b800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581471.052125:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44070a80 x1875463184231808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581471.052150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581471.052154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788581471.052156:0:36:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581471.052159:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:2.0:1788581471.052162:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581471.052169:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d43a55000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581471.052187:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184231808:0@lo:8:kworker.0 00000400:00000100:2.0:1788581471.052274:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184231808 offset 0 length 520: 4 00000100:00100000:2.0:1788581471.052354:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d44072d80 x1875463184231936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581471.052384:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184231936:0@lo:8:kworker.0 00000400:00000100:2.0:1788581471.052411:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184231936 offset 0 length 520: 4 00000100:00100000:2.0:1788581471.052454:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581471.052462:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184232064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.052493:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581471.052544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581471.052548:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581471.052551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581471.052554:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581471.052791:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232064 00000100:00100000:2.0:1788581471.052801:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232064 00000100:00100000:2.0:1788581471.052855:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581471.052868:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184232064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581471.052936:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184232064:12345-0@lo:400:kworker.0 Request processed in 68us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581471.052943:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788581471.052987:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d44071f80 x1875463184232064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581471.052998:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184232064:0@lo:400:kworker.0 00000100:00100000:0.0:1788581471.053148:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+16:3621:x1875463184231296:12345-0@lo:400:kworker.0 Request processed in 9049us (9279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581471.053157:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788581471.054437:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184231296:0@lo:400:kworker.0 10000000:01000000:0.0:1788581471.171386:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581471.171394:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7a4de800 from 13 10000000:01000000:0.0:1788581471.171400:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581471.171445:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581471.171458:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581471.171470:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581471.171495:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581471.171586:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581471.171637:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581471.171678:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232192 00000100:00100000:1.0:1788581471.171686:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232192 00000100:00100000:1.0:1788581471.171743:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581471.171753:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+16:17060:x1875463184232192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581471.171767:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581471.171781:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e8e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.171804:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.171816:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.171826:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5a00, rc 0) 00000100:00100000:1.0:1788581471.171871:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581471.171879:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581471.171922:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581471.171937:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.171946:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581471.172006:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.172047:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581471.172068:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581471.172069:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232320 00000100:00100000:0.0:1788581471.172075:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232320 00000100:00100000:0.0:1788581471.172128:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788581471.172136:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581471.172456:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581471.172463:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581471.173908:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.173956:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.174012:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581471.174052:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581471.174163:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232448 00000100:00100000:0.0:1788581471.174186:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232448 00000100:00100000:0.0:1788581471.174313:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788581471.174325:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581471.174444:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581471.174451:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788581471.174501:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581471.176455:0:18281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788581471.176600:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788581471.176625:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581471.176637:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581471.176650:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581471.176661:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581471.176663:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3d800 from 13 10000000:01000000:0.0:1788581471.176847:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581471.176884:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581471.176893:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581471.176904:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581471.176927:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581471.176986:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581471.177029:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581471.177083:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232576 00000100:00100000:1.0:1788581471.177090:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232576 00000100:00100000:1.0:1788581471.177231:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788581471.177241:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+17:17060:x1875463184232576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581471.177275:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581471.177287:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30e9c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.177322:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.177332:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.177341:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4000, rc 0) 00000100:00100000:1.0:1788581471.177384:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184232576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581471.177390:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788581471.178179:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581471.178197:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.178209:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581471.178298:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.178348:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581471.178431:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581471.178602:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232704 00000100:00100000:2.0:1788581471.178608:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232704 00000100:00100000:2.0:1788581471.178688:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581471.178697:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184232704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581471.178823:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184232704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581471.178831:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581471.178934:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.178964:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581471.179003:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581471.179283:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581471.179359:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232832 00000100:00100000:0.0:1788581471.179370:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232832 00000100:00100000:0.0:1788581471.179394:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788581471.179401:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184232832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581471.179482:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:17060:x1875463184232832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581471.179489:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788581471.180349:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184232832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788581471.181641:0:18282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788581471.181970:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788581471.181997:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581471.182008:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581471.182019:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581471.809474:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581472.065468:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581472.065489:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184232960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581472.065832:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581457/real 1788581457] req@ffff995d43817100 x1875463184223872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581472 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581472.065860:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43817100 x1875463184223872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581472 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581472.065870:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581457/real 1788581457] req@ffff995d43815180 x1875463184224000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581472 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581472.065882:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43815180 x1875463184224000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581472 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581472.065894:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581472.065916:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788581472.065920:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184223872:0@lo:8:kworker.0 00000100:00080000:3.0:1788581472.065925:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581472.065930:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788581472.065933:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184224000:0@lo:8:kworker.0 00000100:00100000:2.0:1788581472.066825:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581472.066869:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184233088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581472.066908:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581472.066951:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184232960 00000100:00100000:2.0:1788581472.066958:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184232960 00000100:00100000:2.0:1788581472.066998:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581472.067007:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184232960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581472.067039:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581472.067082:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184232960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581472.067088:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581472.067107:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233088 00000100:00100000:2.0:1788581472.067110:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233088 00000100:00100000:2.0:1788581472.067129:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581472.067134:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3619:x1875463184233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581472.067159:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:3619:x1875463184233088:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581472.067165:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581472.067201:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184233088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581472.067217:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184232960:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788581472.067386:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581472.067390:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788581472.067393:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581472.067398:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1788581472.067402:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581472.067406:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581472.067425:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43814380 x1875463184233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581472.067439:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581472.067441:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788581472.067450:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581472.067454:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1788581472.067456:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581472.067460:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e4f27e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581472.067471:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817b80 x1875463184233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581472.067490:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581472.067494:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581472.067496:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581472.067499:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581472.067521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184233344:0@lo:400:kworker.0 00000100:00100000:3.0:1788581472.067547:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581472.067563:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581472.067568:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184233216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581472.067583:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581472.067600:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233344 00000100:00100000:3.0:1788581472.067603:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233344 00000100:00100000:3.0:1788581472.067623:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233216 00000100:00100000:3.0:1788581472.067624:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233216 00000100:00100000:3.0:1788581472.067634:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581472.067639:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184233344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581472.067667:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184233344:12345-0@lo:400:kworker.0 Request processed in 28us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581472.067673:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581472.067683:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581472.067693:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184233216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581472.067709:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581472.067810:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184233728:0@lo:400:kworker.0 00000100:00100000:2.0:1788581472.070353:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184233472:0@lo:8:kworker.0 00000100:00100000:1.0:1788581472.071021:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581472.071067:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581472.071085:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184233856:0@lo:400:kworker.0 00000100:00100000:1.0:1788581472.071113:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581472.071153:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233728 00000100:00100000:1.0:1788581472.071161:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233728 00000100:00100000:1.0:1788581472.071201:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233856 00000100:00100000:1.0:1788581472.071204:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233856 00000100:00100000:1.0:1788581472.071221:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581472.071229:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184233728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581472.071309:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184233728:12345-0@lo:400:kworker.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581472.071316:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581472.071333:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581472.071339:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581472.071368:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184233856:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581472.071374:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788581472.071412:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43816d80 x1875463184233856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581472.071426:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184233856:0@lo:400:kworker.0 00010000:00080000:1.0:1788581472.071437:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43816680 x1875463184233728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581472.071445:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184233728:0@lo:400:kworker.0 00000100:00100000:3.0:1788581472.071869:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184233216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4174us (4282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581472.071878:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581472.071921:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184233216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581472.071932:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184233344:0@lo:400:kworker.0 00000400:00000100:2.0:1788581472.074771:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184233472 offset 0 length 520: 4 00000100:00100000:2.0:1788581472.075074:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184233600:0@lo:8:kworker.0 00000400:00000100:2.0:1788581472.075105:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184233600 offset 0 length 520: 4 00000001:00100000:2.0:1788581472.579371:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788581472.835015:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581473.857999:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581473.859966:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581474.885949:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581475.907904:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788581475.998725:0:18565:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788581475.998729:0:18565:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788581475.998731:0:18565:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788581476.001288:0:18565:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e7fa35800 00000020:01000004:0.0:1788581476.001313:0:18565:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788581476.001329:0:18565:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788581476.001365:0:18565:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff995e6f8b4d28) 00000020:00000080:0.0:1788581476.001384:0:18565:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788581476.060500:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788581476.061631:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788581476.062140:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788581476.062397:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788581476.062628:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788581476.062961:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788581476.063167:0:18565:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788581476.066235:0:18565:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788581476.066534:0:18565:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788581476.066547:0:18565:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581476.066558:0:18565:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b30eb1 00000020:01000004:2.0:1788581476.066565:0:18565:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788581476.066588:0:18565:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788581476.066591:0:18565:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788581476.066597:0:18565:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788581476.066601:0:18565:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788581476.066613:0:18565:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff995e7a693370) 00000020:00000080:2.0:1788581476.066625:0:18565:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788581476.067615:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581476.067757:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788581476.067764:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788581476.072449:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581476.072459:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788581476.072816:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788581476.072822:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788581476.074444:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581476.074616:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581476.074621:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788581476.078113:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581476.078125:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788581476.105746:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581476.105977:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581476.105983:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788581476.109642:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788581476.109658:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788581476.111318:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581476.111330:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788581476.114771:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581476.114962:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788581476.114968:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788581476.115890:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581476.115898:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788581476.181668:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581476.181870:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788581476.181878:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788581476.185166:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581476.185180:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788581476.185852:0:18565:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788581476.185881:0:18565:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788581476.185888:0:18565:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788581476.210679:0:18565:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581476.210826:0:18565:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788581476.210831:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581476.210833:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581476.210835:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581476.210836:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581476.210837:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581476.210839:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581476.210840:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581476.210842:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581476.210843:0:18565:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581476.210847:0:18565:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788581476.210849:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581476.210850:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581476.210852:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581476.210853:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581476.210854:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581476.210855:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581476.210861:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581476.210862:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581476.210863:0:18565:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581476.210891:0:18565:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788581476.210912:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184233984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581476.211043:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.211131:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581476.211177:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184233984 00000100:00100000:1.0:1788581476.211184:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184233984 00000100:00100000:0.0:1788581476.211477:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788581476.211488:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:18565:x1875463184233984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788581476.211527:0:17058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788581476.211531:0:17058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788581476.211534:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788581476.211876:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+18:18565:x1875463184233984:12345-0@lo:253:mount.lustre.0 Request processed in 390us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581476.211884:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581476.211949:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184233984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581476.211959:0:18565:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581476.211962:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581476.211963:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581476.211964:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581476.211966:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581476.211967:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581476.211968:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581476.211969:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581476.211970:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581476.211971:0:18565:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581476.211989:0:18565:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e7fa35800 from lustre-OST0000 10000000:01000000:1.0:1788581476.212017:0:18565:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788581476.212020:0:18565:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581476.212027:0:18565:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7a7399b8 local copy 00010000:00010000:1.0:1788581476.212037:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581476.212138:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581476.212173:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.212205:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.212287:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234112 00000100:00100000:2.0:1788581476.212293:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234112 00000100:00100000:2.0:1788581476.212331:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581476.212340:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:18565:x1875463184234112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581476.212418:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+18:18565:x1875463184234112:12345-0@lo:501:mount.lustre.0 Request processed in 78us (242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581476.212425:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581476.212573:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234112:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788581476.212587:0:18565:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788581476.212604:0:18565:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788581476.212610:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.212618:0:18565:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581476.212639:0:18565:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e7fa35800 10000000:01000000:1.0:1788581476.212644:0:18565:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581476.212648:0:18565:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581476.212650:0:18565:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581476.212654:0:18565:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788581476.212657:0:18565:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788581476.212677:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.212684:0:18565:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.212714:0:18565:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581476.212727:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581476.212751:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.212777:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581476.212833:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234240 00000100:00100000:3.0:1788581476.212837:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234240 00000100:00100000:3.0:1788581476.212859:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581476.212866:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+18:18565:x1875463184234240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581476.212875:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581476.212888:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f980a00/0x50f0cc74b7b30ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30ebf expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581476.212908:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980a00/0x50f0cc74b7b30ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30ebf expref: 19 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581476.212917:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f980a00/0x50f0cc74b7b30ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30ebf expref: 19 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581476.212926:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980a00, rc 0) 00000100:00100000:3.0:1788581476.212965:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234240:12345-0@lo:101:mount.lustre.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581476.212971:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581476.213054:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581476.213066:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.213074:0:18565:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581476.214325:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788581476.215066:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581476.219173:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788581476.219226:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788581476.219239:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788581476.219427:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788581476.219450:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788581476.219465:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788581476.219489:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788581476.219495:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788581476.221860:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581476.221927:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.222028:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581476.222077:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234368 00000100:00100000:3.0:1788581476.222100:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234368 00000100:00100000:3.0:1788581476.222188:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788581476.222198:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581476.222383:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234368:12345-0@lo:501:mount.lustre.0 Request processed in 186us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581476.222391:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581476.222479:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581476.222526:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581476.222567:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.223018:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.223082:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234496 00000100:00100000:2.0:1788581476.223088:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234496 00000100:00100000:2.0:1788581476.223115:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581476.223124:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581476.224083:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234496:12345-0@lo:503:mount.lustre.0 Request processed in 957us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.224092:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788581476.224189:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581476.224662:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581476.224751:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.224799:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.224840:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53affa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.225058:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234624 00000100:00100000:2.0:1788581476.225065:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234624 00000100:00100000:2.0:1788581476.225093:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581476.225101:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581476.225557:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234624:12345-0@lo:502:mount.lustre.0 Request processed in 455us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.225564:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788581476.226166:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.226440:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788581476.226484:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788581476.226501:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788581476.226590:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788581476.226604:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788581476.226616:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788581476.226629:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788581476.226641:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788581476.226652:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788581476.226666:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788581476.226679:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788581476.226691:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788581476.226836:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.226889:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.226919:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.226989:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234752 00000100:00100000:2.0:1788581476.226995:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234752 00000100:00100000:2.0:1788581476.227031:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581476.227038:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581476.227140:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234752:12345-0@lo:502:mount.lustre.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.227147:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788581476.227223:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.227380:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788581476.227389:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788581476.228946:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788581476.228955:0:18582:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788581476.228961:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.228963:0:18582:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788581476.228969:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581476.228983:0:18582:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff995d41c00000) 00000020:00000080:3.0:1788581476.229005:0:18582:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788581476.229010:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581476.229101:0:18582:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa35800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788581476.229109:0:18582:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581476.229115:0:18582:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b30ed4 00010000:00010000:3.0:1788581476.233688:0:18582:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788581476.234176:0:18582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788581476.235823:0:18582:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788581476.237160:0:18582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788581476.237170:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581476.237176:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237179:0:18582:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788581476.237182:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788581476.237184:0:18582:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788581476.237186:0:18582:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581476.237187:0:18582:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581476.237189:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788581476.237192:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237193:0:18582:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788581476.237202:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581476.237206:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237208:0:18582:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581476.237211:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581476.237213:0:18582:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581476.237215:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581476.237217:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237218:0:18582:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788581476.237221:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581476.237223:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237224:0:18582:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581476.237227:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788581476.237406:0:18582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581476.237411:0:18582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581476.237413:0:18582:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581476.237416:0:18582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788581476.237621:0:18565:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788581476.237653:0:18565:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788581476.237677:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.237689:0:18565:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581476.237697:0:18565:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7fa35800 from 1 10000000:01000000:1.0:1788581476.237707:0:18565:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581476.237743:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.237751:0:18565:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.237763:0:18565:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581476.237787:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581476.237860:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.237895:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.238055:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184234880 00000100:00100000:2.0:1788581476.238063:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184234880 00000100:00100000:2.0:1788581476.238109:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581476.238118:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+19:18565:x1875463184234880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581476.238132:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581476.238146:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30edb expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.238169:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 20 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.238179:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 20 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.238188:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44400, rc 0) 00000100:00100000:2.0:1788581476.238235:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184234880:12345-0@lo:101:mount.lustre.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.238241:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788581476.238533:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184234880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581476.238548:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.238557:0:18565:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581476.241065:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788581476.241502:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581476.241687:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788581476.241815:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788581476.241833:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788581476.241838:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788581476.241908:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581476.241974:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.242073:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.247372:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235008 00000100:00100000:2.0:1788581476.247388:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235008 00000100:00100000:2.0:1788581476.247446:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581476.247457:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581476.247979:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235008:12345-0@lo:501:mount.lustre.0 Request processed in 523us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.247995:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788581476.256043:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581476.256141:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581476.256227:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.256345:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.257761:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235136 00000100:00100000:2.0:1788581476.257775:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235136 00000100:00100000:2.0:1788581476.257889:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788581476.257901:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581476.258070:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235136:12345-0@lo:503:mount.lustre.0 Request processed in 171us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.258078:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788581476.258171:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581476.258660:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581476.258749:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.258796:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.259059:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.260409:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235264 00000100:00100000:2.0:1788581476.260422:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235264 00000100:00100000:2.0:1788581476.260481:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788581476.260492:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581476.260642:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235264:12345-0@lo:502:mount.lustre.0 Request processed in 151us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.260649:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788581476.260855:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.261051:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788581476.261077:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788581476.261089:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788581476.261100:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788581476.261111:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788581476.261121:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788581476.261132:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788581476.261142:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788581476.261153:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788581476.261177:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788581476.261189:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788581476.261217:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.261548:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.261582:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.261626:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235392 00000100:00100000:2.0:1788581476.261632:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235392 00000100:00100000:2.0:1788581476.261736:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581476.261745:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581476.261835:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235392:12345-0@lo:502:mount.lustre.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.261842:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581476.261901:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581476.261944:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788581476.261952:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788581476.262589:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581476.262598:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262607:0:18586:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788581476.262613:0:18586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7fa35800 00000020:00000080:1.0:1788581476.262615:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581476.262623:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581476.262625:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262626:0:18586:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788581476.262628:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581476.262630:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262632:0:18586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581476.262635:0:18586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7fa35800 00000020:00000080:1.0:1788581476.262636:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581476.262684:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581476.262687:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262688:0:18586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788581476.262690:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581476.262692:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262693:0:18586:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581476.262696:0:18586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7fa35800 00000020:00000080:1.0:1788581476.262698:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581476.262713:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581476.262716:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262717:0:18586:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581476.262720:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581476.262722:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262723:0:18586:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788581476.262726:0:18586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7fa35800 00000020:00000080:1.0:1788581476.262728:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581476.262748:0:18586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581476.262751:0:18586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581476.262752:0:18586:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788581476.262755:0:18586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788581476.262793:0:18565:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581476.262817:0:18565:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581476.262833:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.262851:0:18565:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581476.262905:0:18565:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581476.262908:0:18565:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e7fa35800 10000000:01000000:1.0:1788581476.262912:0:18565:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e7fa35800 10000000:01000000:1.0:1788581476.262915:0:18565:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581476.262920:0:18565:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e7fa35800 from 1 10000000:01000000:1.0:1788581476.262923:0:18565:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581476.262953:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.262961:0:18565:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.262970:0:18565:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581476.262990:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581476.263036:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.267340:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581476.273491:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235520 00000100:00100000:0.0:1788581476.273505:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235520 00000100:00100000:0.0:1788581476.273565:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581476.273576:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:18565:x1875463184235520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581476.273592:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581476.273610:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b30ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30ee9 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.273638:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b30ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30ee9 expref: 21 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.273661:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b30ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30ee9 expref: 21 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.273670:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71400, rc 0) 00000100:00100000:0.0:1788581476.273758:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235520:12345-0@lo:101:mount.lustre.0 Request processed in 183us (10720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581476.273764:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581476.275378:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581476.275405:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.275420:0:18565:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581476.277329:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788581476.277953:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581476.278143:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788581476.278168:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788581476.278184:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788581476.278199:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788581476.278216:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788581476.278245:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788581476.278318:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788581476.278334:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788581476.278346:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788581476.278835:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788581476.278862:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788581476.278877:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788581476.278893:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788581476.278907:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788581476.278922:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788581476.278937:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788581476.278951:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788581476.278964:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788581476.278977:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788581476.278991:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788581476.279003:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788581476.279032:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788581476.279049:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788581476.279065:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788581476.279080:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788581476.279094:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788581476.279109:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788581476.279121:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788581476.279134:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788581476.279158:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788581476.279172:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788581476.279184:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788581476.279196:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788581476.279209:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788581476.279224:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788581476.279238:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788581476.279280:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788581476.279318:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788581476.279325:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788581476.279741:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581476.279883:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.280012:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581476.280069:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235648 00000100:00100000:2.0:1788581476.280078:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235648 00000100:00100000:2.0:1788581476.280130:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581476.280142:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581476.286900:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235648:12345-0@lo:501:mount.lustre.0 Request processed in 6751us (7007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581476.286915:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581476.287724:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581476.287782:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581476.287840:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.287880:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e43fa8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581476.288908:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235776 00000100:00100000:3.0:1788581476.288920:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235776 00000100:00100000:3.0:1788581476.289232:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581476.289245:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581476.289477:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235776:12345-0@lo:503:mount.lustre.0 Request processed in 235us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581476.289485:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581476.291372:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581476.291824:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581476.291908:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.291977:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.299611:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e43fa8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581476.307434:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184235904 00000100:00100000:3.0:1788581476.307455:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184235904 00000100:00100000:3.0:1788581476.307510:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788581476.307520:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581476.307663:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184235904:12345-0@lo:502:mount.lustre.0 Request processed in 145us (15685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581476.307677:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581476.307695:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184235904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.307911:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788581476.307941:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788581476.307957:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788581476.307971:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788581476.307997:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788581476.308010:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788581476.308022:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788581476.308034:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788581476.308052:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788581476.308064:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788581476.308077:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788581476.308090:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788581476.308102:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788581476.308115:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788581476.308127:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788581476.308138:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788581476.308151:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788581476.308164:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788581476.308177:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788581476.308192:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788581476.308219:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788581476.308235:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788581476.308247:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788581476.308305:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788581476.308319:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788581476.308331:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788581476.308343:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788581476.308354:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788581476.308366:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788581476.308377:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788581476.308389:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788581476.308401:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788581476.308415:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788581476.308428:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788581476.308440:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788581476.308466:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788581476.308493:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788581476.308507:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788581476.308518:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788581476.308527:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788581476.308537:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788581476.308556:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788581476.308567:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788581476.308578:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788581476.308589:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788581476.308600:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788581476.308610:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788581476.308621:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788581476.308663:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184236032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.308711:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.308738:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581476.308790:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236032 00000100:00100000:1.0:1788581476.308798:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236032 00000100:00100000:1.0:1788581476.308848:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581476.308858:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184236032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581476.308962:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184236032:12345-0@lo:502:mount.lustre.0 Request processed in 106us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.308970:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581476.310662:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184236032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.310859:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788581476.310887:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788581476.310922:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184236160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581476.310987:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.311031:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581476.311088:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236160 00000100:00100000:1.0:1788581476.311097:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236160 00000100:00100000:1.0:1788581476.311143:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581476.311152:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184236160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581476.311293:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184236160:12345-0@lo:502:mount.lustre.0 Request processed in 140us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.311301:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581476.311320:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184236160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581476.311362:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788581476.311370:0:18565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788581476.311970:0:18592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788581476.311985:0:18592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff995e6f8b0000) 00000020:00000080:0.0:1788581476.312006:0:18592:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788581476.312079:0:18592:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa35800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788581476.312083:0:18592:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7fa35800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788581476.312085:0:18592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa35800 3 00010000:00080000:0.0:1788581476.312114:0:18592:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7a4d9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581476.314906:0:18592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788581476.315099:0:18592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788581476.315142:0:18592:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581476.315154:0:18592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x50f0cc74b7b30efe 00000100:00080000:3.0:1788581476.315165:0:18592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581476.315170:0:18592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a4d9800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581476.315221:0:18592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817100 x1875463184236288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581476.315286:0:18592:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788581476.315314:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184236288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581476.315381:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.315466:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236288 00000100:00100000:0.0:1788581476.315473:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236288 00000100:00100000:0.0:1788581476.315507:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581476.315515:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184236288:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788581476.315536:0:17063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788581476.315565:0:17063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x50f0cc74b7b30f05 00000004:00100000:0.0:1788581476.315579:0:17063:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581476.315609:0:17063:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581476.315656:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875463184236288:12345-0@lo:38:llog_process_th.0 Request processed in 140us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581476.315663:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581476.315699:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43817100 x1875463184236288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581476.315710:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581476.315717:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788581476.315723:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788581476.315727:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788581476.315729:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581476.315735:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184236288:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788581476.315843:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.315852:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.315856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.315859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.315885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.315887:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.315890:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.315893:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581476.315916:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184236544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.315946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.315966:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581476.315971:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316035:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.316061:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316079:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.316089:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581476.316094:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184236672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316109:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.316130:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236544 00000100:00100000:1.0:1788581476.316133:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236544 00000100:00100000:1.0:1788581476.316153:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236800 00000100:00100000:1.0:1788581476.316155:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236800 00000100:00100000:1.0:1788581476.316165:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581476.316170:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184236544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316201:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184236544:12345-0@lo:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.316213:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581476.316227:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581476.316232:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184236800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316293:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184236800:12345-0@lo:400:kworker.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.316299:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581476.316316:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236416 00000100:00100000:1.0:1788581476.316319:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236416 00000100:00100000:1.0:1788581476.316336:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236672 00000100:00100000:1.0:1788581476.316338:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236672 00000100:00100000:1.0:1788581476.316347:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581476.316352:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184236416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316381:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184236416:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.316386:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581476.316396:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581476.316400:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316419:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184236672:12345-0@lo:400:kworker.0 Request processed in 19us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.316424:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581476.316450:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184236672:0@lo:400:kworker.0 00010000:00080000:1.0:1788581476.316460:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d4339c380 x1875463184236800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581476.316470:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788581476.316590:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184236416:0@lo:400:kworker.0 00010000:00080000:1.0:1788581476.316605:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d4339e680 x1875463184236544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581476.316613:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184236544:0@lo:400:kworker.0 00000020:01000004:3.0:1788581476.318092:0:18592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788581476.318108:0:18592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff995d41c04d28) 00000020:00000080:3.0:1788581476.318129:0:18592:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788581476.318237:0:18592:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa35800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788581476.318241:0:18592:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7fa35800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788581476.318244:0:18592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa35800 3 00010000:00080000:3.0:1788581476.318303:0:18592:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e7fb21000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581476.321825:0:18592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788581476.322017:0:18592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788581476.322062:0:18592:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581476.322076:0:18592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x50f0cc74b7b30f13 00000100:00080000:3.0:1788581476.322085:0:18592:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581476.322091:0:18592:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff995e7fb21000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581476.322125:0:18592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43817480 x1875463184236928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581476.322146:0:18592:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788581476.322172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.322176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.322179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.322182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.322185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.322188:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581476.322191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581476.322194:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788581476.322778:0:18592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:0.0:1788581476.323203:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184236928:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788581476.323826:0:18565:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788581476.323861:0:18565:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581476.323886:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.323897:0:18565:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581476.323946:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581476.323949:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581476.323950:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581476.323951:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581476.323953:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581476.323954:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581476.323959:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581476.323960:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581476.323961:0:18565:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581476.323965:0:18565:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788581476.323967:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581476.323969:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581476.323970:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581476.323971:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581476.323971:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581476.323972:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581476.323973:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581476.323974:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581476.323975:0:18565:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581476.323999:0:18565:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788581476.324013:0:18565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184237056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788581476.324079:0:18565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581476.324119:0:18565:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581476.325343:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237056 00000100:00100000:1.0:1788581476.325354:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237056 00000100:00100000:0.0:1788581476.326606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.326686:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184236928 00000100:00100000:0.0:1788581476.326692:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184236928 00000100:00100000:1.0:1788581476.327230:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581476.327243:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184237056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581476.327299:0:17057:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581476.327313:0:17057:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788581476.331859:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581476.331871:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184236928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788581476.331903:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788581476.331962:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x50f0cc74b7b30f1a 00000004:00100000:0.0:1788581476.331980:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581476.332017:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995e7a4dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581476.332146:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875463184236928:12345-0@lo:38:llog_process_th.0 Request processed in 274us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581476.332153:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788581476.334652:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43817480 x1875463184236928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581476.334667:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581476.334677:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788581476.334685:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788581476.334689:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788581476.334693:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fb21000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788581476.334761:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184236928:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788581476.337817:0:17057:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581476.337844:0:17057:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788581476.338018:0:17079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788581476.338022:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788581476.338044:0:17079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338063:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338070:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338077:0:17079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338113:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338126:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581476.338141:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184237184:0@lo:104: 00000100:00100000:2.0:1788581476.338200:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581476.338251:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.338288:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581476.338296:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184237312:0@lo:104: 00000100:00100000:2.0:1788581476.338322:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581476.338349:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581476.338551:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788581476.338575:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237184 00000100:00100000:1.0:1788581476.338582:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237184 00000100:00100000:1.0:1788581476.338612:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237312 00000100:00100000:1.0:1788581476.338615:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237312 00000100:00100000:1.0:1788581476.338630:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581476.338638:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184237184:12345-0@lo:104: 00010000:00010000:1.0:1788581476.338651:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.338722:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581476.338729:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184237184:12345-0@lo:104: Request processed in 92us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.338737:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581476.338754:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581476.338760:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7a480050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184237312:12345-0@lo:104: 00010000:00010000:1.0:1788581476.338768:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.338864:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581476.338869:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7a480050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184237312:12345-0@lo:104: Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581476.338875:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581476.338924:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184237184:0@lo:104: 00010000:00010000:0.0:1788581476.338930:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788581476.338933:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184237312:0@lo:104: 00010000:00010000:0.0:1788581476.338937:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.338944:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581476.338947:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.338950:0:17079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.338956:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.338963:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1788581476.338963:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581476.338969:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581476.338997:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.339004:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581476.339021:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581476.339025:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:18565:x1875463184237056:12345-0@lo:253:mount.lustre.0 Request processed in 11786us (14945us total) trans 0 rc 0/0 00010000:00010000:0.0:1788581476.339028:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f980c00/0x50f0cc74b7b30e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e79 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581476.339032:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1788581476.339047:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581476.339049:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581476.339051:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581476.339068:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184237440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581476.339099:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581476.339153:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237440 00000100:00100000:2.0:1788581476.339157:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237440 00010000:00010000:2.0:1788581476.339176:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581476.339201:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581476.339207:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3620:x1875463184237440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581476.339217:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581476.339222:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.339231:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.339243:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e72 expref: 21 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.339281:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581476.339309:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+20:3620:x1875463184237440:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581476.339315:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581476.339527:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184237440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581476.339566:0:18565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:18565:1875463184237056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581476.339576:0:18565:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581476.339579:0:18565:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581476.339581:0:18565:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581476.339582:0:18565:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581476.339583:0:18565:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581476.339585:0:18565:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581476.339586:0:18565:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581476.339594:0:18565:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581476.339596:0:18565:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581476.339597:0:18565:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788581476.339609:0:18565:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788581476.340127:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581476.340130:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581476.340132:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581476.340167:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340176:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581476.340179:0:17051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340187:0:17051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581476.340195:0:17051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581476.340200:0:17051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581476.340234:0:17051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340240:0:17051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788581476.340312:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184237568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581476.340354:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581476.340437:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237568 00000100:00100000:0.0:1788581476.340443:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237568 00010000:00010000:0.0:1788581476.340526:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 20 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340532:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340539:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b30e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e6b expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581476.340552:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581476.340554:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581476.340554:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788581476.340556:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581476.340561:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:3621:x1875463184237568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581476.340570:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581476.340575:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 20 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340584:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 20 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340595:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4c00/0x50f0cc74b7b30e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e64 expref: 20 pid: 17058 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340618:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340625:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788581476.340643:0:17048:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004939741s 00010000:00010000:0.0:1788581476.340648:0:17048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340655:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340661:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340667:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340672:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581476.340675:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340682:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.340695:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.341349:0:17079:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581476.341360:0:17079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.341889:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b30f21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581476.341905:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581476.341972:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3621:x1875463184237568:12345-0@lo:103:ldlm_bl.0 Request processed in 1408us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581476.341981:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581476.342157:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184237568:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788581476.343460:0:18565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788581476.346906:0:18565:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788581476.346914:0:18565:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788581476.346946:0:18565:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581476.347010:0:18565:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581476.347028:0:18565:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788581476.347047:0:18565:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788581476.352504:0:18565:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581476.352797:0:18565:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581476.939923:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788581477.181447:0:18647:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581477.181612:0:18647:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788581477.187335:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581477.187359:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184237696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581477.187436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581477.187477:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237696 00000100:00100000:1.0:1788581477.187485:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237696 00000100:00100000:1.0:1788581477.187525:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581477.187532:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184237696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581477.187562:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788581477.187611:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184237696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581477.187618:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581477.187661:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184237696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581477.189316:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581477.189336:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184237824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581477.189399:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581477.190245:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237824 00000100:00100000:1.0:1788581477.190279:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237824 00000100:00100000:1.0:1788581477.190330:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581477.190339:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184237824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581477.190373:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581477.190434:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184237824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581477.190441:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581477.190472:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184237824:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1788581477.443731:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581477.443738:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7a4de800 from 9 10000000:01000000:2.0:1788581477.443744:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581477.443796:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581477.443808:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581477.443818:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581477.443844:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184237952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581477.443916:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581477.443998:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184237952 00000100:00100000:1.0:1788581477.444020:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184237952 00000100:00100000:2.0:1788581477.447053:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581477.448056:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581477.448072:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:17060:x1875463184237952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581477.448090:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581477.448109:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30f28 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.448137:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.448150:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.448159:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5000, rc 0) 00000100:00100000:1.0:1788581477.448240:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:17060:x1875463184237952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581477.448247:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581477.448831:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184237952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581477.448851:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581477.448862:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581477.448927:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788581477.448969:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581477.448995:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581477.450666:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238080 00000100:00100000:2.0:1788581477.450809:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238080 00000100:00100000:2.0:1788581477.450880:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581477.450891:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:17060:x1875463184238080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788581477.450916:0:17057:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788581477.450933:0:17057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788581477.450940:0:17057:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788581477.451081:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+20:17060:x1875463184238080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581477.451089:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581477.451333:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581477.451831:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581477.451842:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581477.451853:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581477.451865:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581477.451867:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3d800 from 9 10000000:01000000:2.0:1788581477.451870:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581477.451900:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581477.451908:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581477.451916:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581477.451934:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581477.451975:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581477.452015:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581477.452889:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238208 00000100:00100000:1.0:1788581477.452899:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238208 00000100:00100000:1.0:1788581477.452952:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581477.452961:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+20:17060:x1875463184238208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581477.452976:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581477.452991:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30f36 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.453015:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.453025:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581477.453042:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d4e00, rc 0) 00000100:00100000:1.0:1788581477.453105:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184238208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581477.453111:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581477.455549:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581477.455579:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581477.455593:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581477.455693:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581477.455756:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581477.455791:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581477.458602:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238336 00000100:00100000:1.0:1788581477.458617:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238336 00000100:00100000:1.0:1788581477.458700:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581477.458713:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184238336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788581477.458738:0:17057:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581477.458756:0:17057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581477.458760:0:17057:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788581477.458908:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184238336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581477.458916:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581477.459113:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184238336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788581477.459178:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581477.459189:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581477.459206:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581477.972875:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581478.977452:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581479.361959:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581480.001660:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581481.027968:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581481.793379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581481.793385:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581481.793388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581481.793391:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581481.793416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581481.793419:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581481.793422:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581481.793425:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581481.793492:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184238464:0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.793560:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581481.793608:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238464 00000100:00100000:1.0:1788581481.793612:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184238976:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793617:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238464 00000100:00100000:1.0:1788581481.793641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581481.793672:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581481.793678:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581481.793680:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184238592:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793693:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3620:x1875463184238464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.793709:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581481.793731:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184239104:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793755:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3620:x1875463184238464:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.793767:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581481.793768:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581481.793806:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184238464:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793830:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238976 00000100:00100000:0.0:1788581481.793835:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238976 00000100:00100000:1.0:1788581481.793839:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184238720:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793864:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239104 00000100:00100000:0.0:1788581481.793868:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239104 00000100:00100000:1.0:1788581481.793870:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581481.793886:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184239232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793893:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238720 00000100:00100000:0.0:1788581481.793897:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238720 00000100:00100000:1.0:1788581481.793913:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581481.793926:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239232 00000100:00100000:0.0:1788581481.793930:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239232 00000100:00100000:1.0:1788581481.793932:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581481.793939:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184238848:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.793948:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581481.793957:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184238976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.793965:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581481.794007:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238592 00000100:00100000:0.0:1788581481.794008:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184238976:12345-0@lo:400:kworker.0 Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581481.794012:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238592 00000100:00100000:0.0:1788581481.794018:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581481.794036:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581481.794042:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184238848 00000100:00100000:0.0:1788581481.794046:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184239104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.794047:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184238848 00000100:00100000:1.0:1788581481.794064:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581481.794074:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184238592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.794084:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184239104:12345-0@lo:400:kworker.0 Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.794091:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581481.794115:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184238592:12345-0@lo:400:kworker.0 Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.794121:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581481.794131:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184238720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.794133:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581481.794151:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581481.794158:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184238848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.794177:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184238720:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.794184:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581481.794198:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184238848:12345-0@lo:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.794202:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581481.794210:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581481.794213:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184239232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.794275:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184239232:12345-0@lo:400:kworker.0 Request processed in 64us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581481.794282:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788581481.794314:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581481.794319:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581481.794344:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184238592:0@lo:400:kworker.0 00010000:00080000:0.0:1788581481.794361:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4339e680 x1875463184239104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581481.794371:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184238848:0@lo:400:kworker.0 00010000:00080000:1.0:1788581481.794386:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4339e300 x1875463184238720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581481.794387:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184239104:0@lo:400:kworker.0 00000100:00100000:1.0:1788581481.794400:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184238720:0@lo:400:kworker.0 00010000:00080000:0.0:1788581481.794412:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4339ce00 x1875463184238976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788581481.794415:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d4339dc00 x1875463184239232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581481.794436:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184239232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581481.794437:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184238976:0@lo:400:kworker.0 00010000:00010000:1.0:1788581482.049509:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581482.306427:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184239360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581482.306496:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581482.306556:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239360 00000100:00100000:3.0:1788581482.306562:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239360 00000100:00100000:3.0:1788581482.306609:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581482.306619:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184239360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581482.306650:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581482.306690:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184239360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581482.306696:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581482.306737:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184239360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581482.309478:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184239488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581482.309544:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581482.309604:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239488 00000100:00100000:2.0:1788581482.309618:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239488 00000100:00100000:2.0:1788581482.309662:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581482.309670:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184239488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581482.309701:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581482.309742:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184239488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581482.309749:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581482.309788:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184239488:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788581483.077540:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581483.079298:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581483.101510:0:18936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1788581484.052836:0:18989:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581484.053049:0:18989:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581484.103155:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581484.881248:0:19039:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581484.881570:0:19039:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581485.121398:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581486.145385:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581486.593380:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581471/real 1788581471] req@ffff995d44072d80 x1875463184231936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581486 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.593412:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d44072d80 x1875463184231936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581486 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.593423:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581471/real 1788581471] req@ffff995d44070a80 x1875463184231808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581486 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.593433:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d44070a80 x1875463184231808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581486 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581486.593451:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581486.593477:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581486.593481:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184231936:0@lo:8:kworker.0 00000100:00080000:2.0:1788581486.593487:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581486.593492:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581486.593495:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184231808:0@lo:8:kworker.0 00000100:00080000:3.0:1788581486.593962:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581486.593967:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581486.593969:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581486.593981:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581486.593999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581486.594002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788581486.594005:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581486.594010:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788581486.594021:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581486.594027:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e7fa8b800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581486.594048:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e43278380 x1875463184240128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581486.594057:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184240000:0@lo:400:kworker.0 00000100:00080000:3.0:1788581486.594061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581486.594064:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788581486.594065:0:8:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581486.594068:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788581486.594070:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788581486.594074:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d43a55000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581486.594083:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e43278000 x1875463184240256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581486.594117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.594119:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184239872:0@lo:400:kworker.0 00000100:00100000:2.0:1788581486.594175:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788581486.594175:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184239744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581486.594251:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240000 00000100:00100000:0.0:1788581486.594302:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240000 00000100:00100000:0.0:1788581486.594343:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581486.594351:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184240000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581486.594433:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.594455:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184240640:0@lo:400:kworker.0 00000100:00100000:3.0:1788581486.594477:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.594514:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239872 00000100:00100000:3.0:1788581486.594519:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239872 00000100:00100000:3.0:1788581486.594545:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240640 00000100:00100000:3.0:1788581486.594548:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240640 00000100:00100000:3.0:1788581486.594585:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581486.594592:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184239872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581486.594627:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184239872:12345-0@lo:400:kworker.0 Request processed in 36us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581486.594646:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581486.594668:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581486.594673:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184240640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581486.594702:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184240640:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581486.594708:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788581486.594741:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43816d80 x1875463184239872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581486.594753:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184239872:0@lo:400:kworker.0 00010000:00080000:3.0:1788581486.594763:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e43278e00 x1875463184240640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581486.594770:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184240640:0@lo:400:kworker.0 00000100:00100000:3.0:1788581486.594805:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184240128:0@lo:8:kworker.0 00000100:00100000:3.0:1788581486.594830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.594854:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184240256:0@lo:8:kworker.0 00000100:00100000:3.0:1788581486.594877:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.594930:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240128 00000100:00100000:3.0:1788581486.594934:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240128 00000100:00100000:3.0:1788581486.594948:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240256 00000100:00100000:3.0:1788581486.594973:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240256 00000100:00100000:3.0:1788581486.594984:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581486.594989:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184240128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788581486.595747:0:18570:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788581486.595782:0:18570:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30f44 00002000:00100000:3.0:1788581486.595796:0:18570:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff995e7a6d3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788581486.595801:0:18570:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788581486.595811:0:18570:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788581486.596805:0:18570:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788581486.596840:0:18570:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581486.596926:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184240128:12345-0@lo:8:kworker.0 Request processed in 1933us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581486.596935:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581486.596963:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581486.596969:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184240256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788581486.597584:0:18570:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581486.601906:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581486.601970:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184240384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581486.602089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581486.602151:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240384 00000100:00100000:2.0:1788581486.602159:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240384 00000100:00100000:2.0:1788581486.602214:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581486.602224:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184240384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581486.602345:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184240384:12345-0@lo:400:kworker.0 Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581486.602353:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788581486.602693:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e4327b480 x1875463184240384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.602708:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184240384:0@lo:400:kworker.0 00010000:00080000:2.0:1788581486.602772:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e43278380 x1875463184240128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.602781:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581486.602790:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788581486.602798:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788581486.602803:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788581486.602806:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788581486.602822:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788581486.602827:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184240128:0@lo:8:kworker.0 00000004:00080000:2.0:1788581486.602871:0:17805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788581486.602886:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184240896:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788581486.602928:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581486.602944:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581486.602961:0:18571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788581486.602968:0:18571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788581486.603813:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184240768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581486.603851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581486.604700:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240896 00000100:00100000:2.0:1788581486.604708:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240896 00000100:00100000:1.0:1788581486.604791:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581486.604819:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581486.604821:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184240512:0@lo:400:kworker.0 00000100:00100000:2.0:1788581486.604827:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17805:x1875463184240896:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788581486.604847:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581486.604885:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240512 00000100:00100000:1.0:1788581486.604889:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240512 00000100:00100000:1.0:1788581486.604916:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581486.604922:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184240512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581486.604962:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184240512:12345-0@lo:400:kworker.0 Request processed in 40us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.604968:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581486.604989:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239616 00000100:00100000:1.0:1788581486.604993:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239616 00000100:00100000:1.0:1788581486.605028:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581486.605035:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3621:x1875463184239616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581486.605070:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3621:x1875463184239616:12345-0@lo:400:kworker.0 Request processed in 35us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.605076:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581486.605100:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184239744 00000100:00100000:1.0:1788581486.605103:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184239744 00000100:00100000:1.0:1788581486.605123:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581486.605129:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184239744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581486.605159:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184239744:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.605165:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581486.605210:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788581486.605243:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184239744:0@lo:400:kworker.0 00010000:00080000:1.0:1788581486.605269:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e4327bb80 x1875463184240512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581486.605280:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184240512:0@lo:400:kworker.0 00000004:00080000:1.0:1788581486.605324:0:17804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581486.605401:0:17804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 472747146284ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581486.605407:0:17804:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1788581486.605426:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581486.605430:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581486.605432:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581486.605614:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184240768 00000100:00100000:1.0:1788581486.605619:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184240768 00000100:00100000:1.0:1788581486.605658:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581486.605665:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3620:x1875463184240768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581486.605683:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581486.605722:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3620:x1875463184240768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.605728:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581486.605757:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d44072d80 x1875463184240768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581486.605773:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184240768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581486.606564:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184240000:12345-0@lo:400:kworker.0 Request processed in 12210us (12442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.606572:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581486.608033:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184240000:0@lo:400:kworker.0 00000004:00080000:1.0:1788581486.610580:0:17796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788581486.615223:0:19099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788581486.615234:0:19099:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788581486.615369:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17805:x1875463184240896:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10538us (12436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581486.615390:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788581486.615585:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d44071880 x1875463184240896/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581502 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581486.615600:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184240896:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788581486.615615:0:17805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788581486.615666:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184241024:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788581486.615718:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581486.615744:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581486.615766:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241024 00000100:00100000:1.0:1788581486.615771:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241024 00000100:00100000:1.0:1788581486.615812:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581486.615820:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17805:x1875463184241024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788581486.615846:0:18571:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788581486.615880:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17805:x1875463184241024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581486.615885:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581486.615914:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43a94e00 x1875463184241024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581502 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581486.615923:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184241024:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788581486.615931:0:17805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788581486.615954:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184241152:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788581486.616054:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581486.616069:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581486.616557:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241152 00000100:00100000:2.0:1788581486.616562:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241152 00000100:00100000:2.0:1788581486.616589:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581486.616595:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17805:x1875463184241152:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788581486.616622:0:19099:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788581486.634032:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184240256:12345-0@lo:8:kworker.0 Request processed in 37055us (39145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581486.634049:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788581486.634850:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581486.634858:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581486.634862:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184240256:0@lo:8:kworker.0 00000001:00080000:0.0:1788581486.647692:0:18566:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788581486.647707:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788581486.653139:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17805:x1875463184241152:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36534us (37153us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788581486.653153:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788581486.655779:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43a94e00 x1875463184241152/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581502 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581486.655795:0:17805:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788581486.655802:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17805:1875463184241152:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788581486.655819:0:17805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788581486.655874:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17805:1875463184241280:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788581486.655932:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581486.656031:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581486.661718:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241280 00000100:00100000:3.0:1788581486.661734:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241280 00000100:00100000:3.0:1788581486.661830:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581486.661842:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1875463184241280:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788581486.661949:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1875463184241280:12345-0@lo:900:osp-pre-0-1.0 Request processed in 109us (6016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581486.661965:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581486.662097:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e43279500 x1875463184241280/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581502 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581486.662112:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17805:1875463184241280:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788581487.170044:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581487.427132:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581487.427157:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184241408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581487.427234:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581487.427297:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241408 00000100:00100000:1.0:1788581487.427304:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241408 00000100:00100000:1.0:1788581487.427345:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581487.427360:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184241408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581487.427406:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581487.427447:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184241408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581487.427455:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581487.427498:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184241408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581487.428560:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581487.428573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184241536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581487.428613:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581487.428644:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241536 00000100:00100000:1.0:1788581487.428650:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241536 00000100:00100000:1.0:1788581487.428679:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581487.428686:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184241536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581487.428708:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788581487.428742:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184241536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581487.428762:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581487.428795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184241536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581488.196992:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581489.220605:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581489.602123:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581490.245773:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581491.265385:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581491.531699:0:19385:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581491.531703:0:19385:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788581491.531705:0:19385:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788581491.531838:0:19385:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e50dc7800 00000020:01000004:2.0:1788581491.531857:0:19385:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788581491.531872:0:19385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788581491.531885:0:19385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff995e7a694d28) 00000020:00000080:2.0:1788581491.531901:0:19385:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788581491.642738:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788581491.649887:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788581491.650768:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788581491.651118:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788581491.651394:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788581491.651723:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788581491.651978:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788581491.653986:0:19385:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788581491.654983:0:19385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788581491.654999:0:19385:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788581491.655534:0:19385:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b30f52 00000020:01000004:1.0:1788581491.655543:0:19385:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788581491.655568:0:19385:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788581491.656085:0:19385:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788581491.656096:0:19385:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788581491.656154:0:19385:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788581491.656159:0:19385:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788581491.687325:0:19385:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581491.687366:0:19385:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788581491.687371:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581491.687379:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581491.687381:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581491.687383:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581491.687384:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581491.687385:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581491.687387:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581491.687388:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581491.687389:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581491.687393:0:19385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788581491.687395:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581491.687396:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581491.687397:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581491.687398:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581491.687399:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581491.687400:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581491.687401:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581491.687402:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581491.687403:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581491.687429:0:19385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788581491.687449:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581491.687523:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.687566:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.687673:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241664 00000100:00100000:1.0:1788581491.687681:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241664 00000100:00100000:1.0:1788581491.687834:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788581491.687843:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:19385:x1875463184241664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581491.687870:0:17058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788581491.687873:0:17058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788581491.687877:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788581491.688195:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:19385:x1875463184241664:12345-0@lo:253:mount.lustre.0 Request processed in 353us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.688204:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581491.688391:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241664:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581491.688400:0:19385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788581491.688403:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581491.688404:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581491.688405:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581491.688407:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581491.688408:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581491.688409:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581491.688411:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581491.688412:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581491.688413:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788581491.688429:0:19385:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e50dc7800 from lustre-OST0001 10000000:01000000:0.0:1788581491.688453:0:19385:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788581491.688455:0:19385:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788581491.688463:0:19385:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e7a7399b8 local copy 00010000:00010000:0.0:1788581491.688479:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581491.688553:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581491.688591:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.688881:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.688912:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241792 00000100:00100000:1.0:1788581491.688917:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241792 00000100:00100000:1.0:1788581491.688950:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788581491.688957:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:19385:x1875463184241792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.689157:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:19385:x1875463184241792:12345-0@lo:501:mount.lustre.0 Request processed in 199us (564us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581491.689164:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581491.689412:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241792:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788581491.689429:0:19385:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788581491.689447:0:19385:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788581491.689454:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.689464:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581491.689489:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e50dc7800 10000000:01000000:0.0:1788581491.689493:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788581491.689497:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788581491.689500:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581491.689504:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788581491.689507:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581491.689528:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.689535:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.689543:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581491.689692:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581491.689724:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.689784:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581491.689814:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184241920 00000100:00100000:3.0:1788581491.689818:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184241920 00000100:00100000:3.0:1788581491.689873:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788581491.689881:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:19385:x1875463184241920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581491.689890:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581491.689901:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f980200/0x50f0cc74b7b30f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30f59 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.689920:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980200/0x50f0cc74b7b30f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f59 expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.689929:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f980200/0x50f0cc74b7b30f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f59 expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.689938:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980200, rc 0) 00000100:00100000:3.0:1788581491.689972:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184241920:12345-0@lo:101:mount.lustre.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.689978:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581491.690033:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184241920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581491.690044:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.690054:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581491.691179:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788581491.691927:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581491.694831:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788581491.694893:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788581491.694913:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788581491.694929:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788581491.694943:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788581491.694955:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788581491.694982:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788581491.694988:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788581491.695198:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581491.695467:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581491.695545:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebe4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.695712:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242048 00000100:00100000:1.0:1788581491.695720:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242048 00000100:00100000:1.0:1788581491.695808:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788581491.695818:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.695959:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242048:12345-0@lo:501:mount.lustre.0 Request processed in 142us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.695967:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788581491.696048:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581491.696080:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581491.696115:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581491.696396:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebe4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581491.696518:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242176 00000100:00100000:0.0:1788581491.696524:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242176 00000100:00100000:0.0:1788581491.696547:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788581491.696554:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581491.697483:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242176:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.697493:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788581491.697804:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581491.698368:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581491.698445:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581491.698499:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581491.698531:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebe4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581491.698792:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242304 00000100:00100000:0.0:1788581491.698799:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242304 00000100:00100000:0.0:1788581491.698836:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788581491.698845:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.699219:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242304:12345-0@lo:502:mount.lustre.0 Request processed in 373us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.699226:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581491.699358:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581491.699535:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788581491.699559:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788581491.699721:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788581491.699745:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788581491.699759:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788581491.699772:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788581491.699786:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788581491.699799:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788581491.699814:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788581491.699844:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581491.699888:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.699922:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581491.700084:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242432 00000100:00100000:2.0:1788581491.700090:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242432 00000100:00100000:2.0:1788581491.700115:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788581491.700121:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581491.700229:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242432:12345-0@lo:502:mount.lustre.0 Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581491.700236:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581491.700437:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581491.700482:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788581491.700490:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788581491.701713:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581491.701723:0:19389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788581491.701730:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.701733:0:19389:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788581491.701740:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581491.701754:0:19389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff995e47870000) 00000020:00000080:1.0:1788581491.701778:0:19389:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788581491.701794:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581491.701860:0:19389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e50dc7800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788581491.701869:0:19389:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581491.701876:0:19389:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b30f6e 00010000:00010000:2.0:1788581491.706987:0:19389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788581491.707738:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788581491.709541:0:19389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788581491.711084:0:19389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788581491.711096:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581491.711102:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581491.711105:0:19389:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788581491.711108:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581491.711112:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581491.711113:0:19389:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581491.711117:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581491.711119:0:19389:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581491.711121:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581491.711124:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581491.711125:0:19389:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581491.711128:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581491.711130:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581491.711131:0:19389:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581491.711134:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788581491.711161:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581491.711165:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581491.711166:0:19389:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581491.711181:0:19389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788581491.711470:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788581491.711503:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788581491.711525:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.711537:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581491.711544:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e50dc7800 from 1 10000000:01000000:3.0:1788581491.711556:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581491.711608:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.711616:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.711628:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581491.711650:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788581491.711716:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581491.711765:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e52c49e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.711829:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242560 00000100:00100000:1.0:1788581491.711836:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242560 00000100:00100000:1.0:1788581491.711887:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581491.711897:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+22:19385:x1875463184242560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581491.711910:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581491.711922:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30f75 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.711945:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.711956:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.711965:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f9d5600, rc 0) 00000100:00100000:1.0:1788581491.712013:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242560:12345-0@lo:101:mount.lustre.0 Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.712021:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788581491.712217:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581491.712231:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.712240:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581491.713850:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788581491.714145:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581491.714410:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788581491.714438:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788581491.714457:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788581491.714462:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788581491.714536:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.714612:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.714659:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581491.716748:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242688 00000100:00100000:3.0:1788581491.716762:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242688 00000100:00100000:3.0:1788581491.716827:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788581491.716837:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581491.716992:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242688:12345-0@lo:501:mount.lustre.0 Request processed in 157us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.716999:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581491.717192:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.717236:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581491.717327:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.717353:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581491.718127:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242816 00000100:00100000:3.0:1788581491.718135:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242816 00000100:00100000:3.0:1788581491.718198:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581491.718206:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581491.718339:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242816:12345-0@lo:503:mount.lustre.0 Request processed in 133us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.718346:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788581491.719157:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242816:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581491.722038:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581491.722139:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581491.722230:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.722297:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581491.725743:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184242944 00000100:00100000:0.0:1788581491.725757:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184242944 00000100:00100000:0.0:1788581491.725818:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581491.725830:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.725988:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184242944:12345-0@lo:502:mount.lustre.0 Request processed in 161us (3757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.725997:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788581491.726207:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184242944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581491.726476:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788581491.726508:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788581491.726523:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788581491.726537:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788581491.726552:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788581491.727233:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788581491.727283:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788581491.727302:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788581491.727317:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788581491.727332:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788581491.727345:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788581491.727388:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581491.727451:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.727492:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581491.727556:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243072 00000100:00100000:0.0:1788581491.727564:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243072 00000100:00100000:0.0:1788581491.727744:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581491.727753:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184243072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.727853:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184243072:12345-0@lo:502:mount.lustre.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.727861:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788581491.727951:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581491.727996:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788581491.728198:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788581491.730730:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581491.730742:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.730745:0:19393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788581491.730753:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e50dc7800 00000020:00000080:1.0:1788581491.730756:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581491.730763:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581491.730765:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.730767:0:19393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788581491.730770:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581491.730771:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.730773:0:19393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581491.730776:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e50dc7800 00000020:00000080:1.0:1788581491.730778:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581491.730879:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581491.730883:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.730885:0:19393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788581491.730888:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581491.730890:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.730892:0:19393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581491.730895:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e50dc7800 00000020:00000080:1.0:1788581491.730897:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581491.740461:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581491.740559:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.740562:0:19393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581491.740577:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581491.740582:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.740584:0:19393:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788581491.740589:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e50dc7800 00000020:00000080:1.0:1788581491.740591:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581491.740666:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581491.740669:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581491.740671:0:19393:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788581491.740674:0:19393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788581491.742778:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581491.742829:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581491.742847:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.742859:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581491.742925:0:19385:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581491.742929:0:19385:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e50dc7800 10000000:01000000:1.0:1788581491.742932:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e50dc7800 10000000:01000000:1.0:1788581491.742936:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581491.742942:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e50dc7800 from 1 10000000:01000000:1.0:1788581491.742945:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581491.742979:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.742987:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.742997:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581491.743033:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581491.743098:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.747617:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243200 00000100:00100000:0.0:1788581491.747633:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243200 00000100:00100000:0.0:1788581491.747690:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581491.747701:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:19385:x1875463184243200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581491.747718:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581491.747737:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b30f83 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.747766:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f83 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.747776:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f83 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581491.747796:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71000, rc 0) 00000100:00100000:0.0:1788581491.747870:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243200:12345-0@lo:101:mount.lustre.0 Request processed in 171us (4771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.747877:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788581491.748182:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.748206:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581491.748223:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581491.748243:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581491.749538:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788581491.749915:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581491.750157:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788581491.750195:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788581491.750211:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788581491.750224:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788581491.750235:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788581491.750249:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788581491.750743:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788581491.750760:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788581491.750774:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788581491.750788:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788581491.750803:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788581491.750833:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788581491.750849:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788581491.750863:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788581491.750875:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788581491.750888:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788581491.750900:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788581491.750913:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788581491.750925:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788581491.750938:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788581491.750951:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788581491.750963:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788581491.750976:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788581491.750991:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788581491.755451:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788581491.755513:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788581491.755547:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788581491.755580:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788581491.755658:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788581491.755680:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788581491.755695:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788581491.755710:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788581491.755725:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788581491.755738:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788581491.755750:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788581491.755762:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788581491.755774:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788581491.755787:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788581491.755800:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788581491.755814:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788581491.755828:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788581491.755842:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788581491.755855:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788581491.755885:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788581491.755902:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788581491.755914:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788581491.755940:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788581491.755946:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788581491.757180:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.757247:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.757312:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243328 00000100:00100000:1.0:1788581491.757319:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243328 00000100:00100000:1.0:1788581491.757369:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788581491.757378:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.757486:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243328:12345-0@lo:501:mount.lustre.0 Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.757503:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788581491.757543:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.757562:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581491.757590:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581491.760186:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.760235:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.760296:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243456 00000100:00100000:1.0:1788581491.760303:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243456 00000100:00100000:1.0:1788581491.760347:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788581491.760356:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581491.760476:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243456:12345-0@lo:503:mount.lustre.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.760483:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788581491.760546:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581491.762513:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581491.763754:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581491.763829:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.763881:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243584 00000100:00100000:1.0:1788581491.763888:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243584 00000100:00100000:1.0:1788581491.763930:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788581491.763939:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.764320:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.764613:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243584:12345-0@lo:502:mount.lustre.0 Request processed in 673us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.764622:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581491.770792:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581491.771127:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788581491.771158:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788581491.771184:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788581491.771199:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788581491.771211:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788581491.771223:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788581491.771235:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788581491.771246:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788581491.771285:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788581491.771300:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788581491.771312:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788581491.771323:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788581491.771335:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788581491.771346:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788581491.771357:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788581491.771369:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788581491.771382:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788581491.771395:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788581491.771406:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788581491.771418:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788581491.771429:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788581491.771440:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788581491.771452:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788581491.771477:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788581491.771491:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788581491.771517:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788581491.771530:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788581491.771541:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788581491.771553:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788581491.771565:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788581491.771577:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788581491.771590:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788581491.772087:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788581491.772110:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788581491.772123:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788581491.772135:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788581491.772146:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788581491.772159:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788581491.772184:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788581491.772199:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788581491.772211:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788581491.772238:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788581491.772681:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788581491.772703:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788581491.772719:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788581491.772732:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788581491.772745:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788581491.772760:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788581491.772812:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.772887:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.772939:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243712 00000100:00100000:0.0:1788581491.772946:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243712 00000100:00100000:0.0:1788581491.772994:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788581491.774022:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.774180:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243712:12345-0@lo:502:mount.lustre.0 Request processed in 1166us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.774188:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788581491.774278:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d41c20d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581491.774302:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581491.774487:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788581491.774514:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788581491.774542:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581491.774582:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.774740:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d41c20d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.776114:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243840 00000100:00100000:1.0:1788581491.776127:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243840 00000100:00100000:1.0:1788581491.776183:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581491.776193:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581491.776347:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184243840:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.776355:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788581491.776729:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184243840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581491.776812:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788581491.776825:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788581491.778494:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788581491.778511:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff995e6f8b19b8) 00000020:00000080:0.0:1788581491.778537:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788581491.778703:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e50dc7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581491.778708:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e50dc7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581491.778710:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e50dc7800 3 00010000:00080000:0.0:1788581491.778741:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e71e5e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1788581491.781556:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788581491.781969:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788581491.782025:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788581491.782036:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x50f0cc74b7b30f98 00000100:00080000:0.0:1788581491.782046:0:19398:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581491.782051:0:19398:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995e71e5e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581491.782089:0:19398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a1880 x1875463184243968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581491.782135:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184243968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581491.782214:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.782301:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184243968 00000100:00100000:0.0:1788581491.782308:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184243968 00000100:00100000:0.0:1788581491.782338:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581491.782345:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184243968:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788581491.782367:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1788581491.782409:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x50f0cc74b7b30f9f 00000004:00100000:0.0:1788581491.782426:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581491.782465:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995d43b12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581491.782513:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875463184243968:12345-0@lo:38:llog_process_th.0 Request processed in 166us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.782521:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788581491.782554:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a1880 x1875463184243968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.782565:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581491.782572:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788581491.782578:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788581491.782582:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788581491.782584:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581491.782589:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184243968:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788581491.783018:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788581491.783074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581491.783079:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581491.783088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581491.783091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581491.783124:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581491.783126:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788581491.783129:0:8:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581491.783133:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788581491.783137:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788581491.783141:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d43a55000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581491.783155:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7b2a2680 x1875463184244608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581491.783210:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783246:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783295:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783319:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783341:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581491.783347:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184244480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783374:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783399:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783438:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783456:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184244864:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783477:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783494:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581491.783500:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184244352:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783522:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783549:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184244992:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.783570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581491.783594:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244096 00000100:00100000:0.0:1788581491.783935:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244096 00000100:00100000:0.0:1788581491.783974:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244352 00000100:00100000:0.0:1788581491.783978:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244352 00000100:00100000:0.0:1788581491.783996:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581491.784069:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184244096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784121:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184244096:12345-0@lo:400:kworker.0 Request processed in 55us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784129:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581491.784144:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581491.784151:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784197:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184244352:12345-0@lo:400:kworker.0 Request processed in 47us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784203:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581491.784235:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244736 00000100:00100000:0.0:1788581491.784242:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244736 00000100:00100000:0.0:1788581491.784322:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244224 00000100:00100000:0.0:1788581491.784325:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244224 00000100:00100000:0.0:1788581491.784336:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244864 00000100:00100000:0.0:1788581491.784338:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244864 00000100:00100000:0.0:1788581491.784358:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244992 00000100:00100000:0.0:1788581491.784361:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244992 00000100:00100000:0.0:1788581491.784374:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581491.784380:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184244736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784411:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184244736:12345-0@lo:400:kworker.0 Request processed in 31us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784427:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581491.784441:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581491.784446:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184244224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784474:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184244224:12345-0@lo:400:kworker.0 Request processed in 28us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784484:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581491.784495:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581491.784501:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184244864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784526:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184244864:12345-0@lo:400:kworker.0 Request processed in 26us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784532:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581491.784544:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581491.784550:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184244992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784576:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184244992:12345-0@lo:400:kworker.0 Request processed in 26us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784582:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581491.784682:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244480 00000100:00100000:0.0:1788581491.784687:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244480 00000100:00100000:0.0:1788581491.784717:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581491.784724:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184244480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784755:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184244480:12345-0@lo:400:kworker.0 Request processed in 32us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.784761:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788581491.784789:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581491.784793:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581491.784802:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788581491.784832:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a2300 x1875463184244480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.784845:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184244480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784857:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184244096:0@lo:400:kworker.0 00010000:00080000:0.0:1788581491.784867:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a1500 x1875463184244736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.784875:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.784909:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184244352:0@lo:400:kworker.0 00010000:00080000:0.0:1788581491.784919:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a0e00 x1875463184244992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.784928:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184244992:0@lo:400:kworker.0 00010000:00080000:0.0:1788581491.784939:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a1c00 x1875463184244224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.784947:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184244224:0@lo:400:kworker.0 00010000:00080000:0.0:1788581491.784957:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7b2a0700 x1875463184244864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581491.784965:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184244864:0@lo:400:kworker.0 00000100:00100000:0.0:1788581491.785086:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184244608:0@lo:8:kworker.0 00000100:00100000:0.0:1788581491.785119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581491.785829:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184244608 00000100:00100000:3.0:1788581491.785837:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184244608 00000100:00100000:3.0:1788581491.785872:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581491.785878:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184244608:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788581491.785952:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184244608:12345-0@lo:8:kworker.0 Request processed in 72us (831us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581491.785959:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581491.785990:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581491.785997:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581491.786013:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788581491.786017:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184244608:0@lo:8:kworker.0 00000020:01000004:1.0:1788581491.798914:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788581491.798932:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff995e47874d28) 00000020:00000080:1.0:1788581491.798957:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788581491.799063:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e50dc7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581491.799067:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e50dc7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581491.799070:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e50dc7800 3 00010000:00080000:1.0:1788581491.799101:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4f0d8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581491.802326:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788581491.802542:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788581491.803830:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581491.803845:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x50f0cc74b7b30fad 00000100:00080000:1.0:1788581491.803857:0:19398:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581491.803863:0:19398:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff995e4f0d8800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581491.803895:0:19398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43a97480 x1875463184245120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581491.803917:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788581491.804091:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184245120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788581491.804162:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581491.804525:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245120 00000100:00100000:1.0:1788581491.804533:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245120 00000100:00100000:1.0:1788581491.808211:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581491.808225:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184245120:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788581491.808276:0:17064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1788581491.808331:0:17064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x50f0cc74b7b30fb4 00000004:00100000:1.0:1788581491.808351:0:17064:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581491.808388:0:17064:0:(import.c:65:import_set_state_nolock()) ffff995d4389f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581491.808490:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875463184245120:12345-0@lo:38:llog_process_th.0 Request processed in 265us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581491.808498:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788581491.808740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581491.808745:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581491.808755:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581491.808758:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788581491.812206:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43a97480 x1875463184245120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581491.812222:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581491.812231:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788581491.812240:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788581491.812245:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788581491.812248:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f0d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1788581491.812454:0:19398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788581491.812528:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788581491.812560:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581491.812575:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581491.812599:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788581491.812648:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788581491.812650:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581491.812652:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581491.812653:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581491.812654:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581491.812655:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581491.812657:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581491.812659:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581491.812660:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581491.812664:0:19385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788581491.812667:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581491.812668:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581491.812669:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581491.812670:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581491.812670:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581491.812672:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581491.812672:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581491.812674:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581491.812675:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581491.812697:0:19385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788581491.812714:0:19385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184245248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581491.812775:0:19385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581491.812818:0:19385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51efac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581491.813102:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245248 00000100:00100000:1.0:1788581491.813109:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245248 00000100:00100000:1.0:1788581491.813155:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788581491.813164:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184245248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581491.813201:0:17056:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788581491.813216:0:17056:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788581491.813384:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184245120:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788581491.822737:0:17056:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788581491.822756:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788581491.823083:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:19385:x1875463184245248:12345-0@lo:253:mount.lustre.0 Request processed in 9913us (10301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581491.823095:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:3.0:1788581491.823269:0:17079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581491.823274:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581491.823294:0:17079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823309:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823317:0:17079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823323:0:17079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823357:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823370:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 23 pid: 17058 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581491.823383:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184245376:0@lo:104: 00000100:00100000:3.0:1788581491.823418:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581491.823457:0:17079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823465:0:17079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581491.823473:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184245504:0@lo:104: 00000100:00100000:3.0:1788581491.823493:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581491.823517:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e52c496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581491.823534:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245376 00000100:00100000:3.0:1788581491.823541:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245376 00000100:00100000:3.0:1788581491.823583:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245504 00000100:00100000:3.0:1788581491.823586:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245504 00000100:00100000:3.0:1788581491.823663:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581491.823673:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184245376:12345-0@lo:104: 00010000:00010000:3.0:1788581491.823685:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823730:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581491.823736:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+4:17079:x1875463184245376:12345-0@lo:104: Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.823743:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581491.823757:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581491.823763:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184245504:12345-0@lo:104: 00010000:00010000:3.0:1788581491.823771:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823804:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581491.823810:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:611141c5-6f74-41ea-b38f-6fb1248f7899+3:17079:x1875463184245504:12345-0@lo:104: Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.823816:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581491.823847:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184245376:0@lo:104: 00000100:00100000:3.0:1788581491.823856:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17079:1875463184245504:0@lo:104: 00010000:00010000:3.0:1788581491.823872:0:17079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823888:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581491.823899:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823906:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581491.823909:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823917:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581491.823924:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581491.823929:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581491.823957:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823963:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581491.823981:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.823988:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b30f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f3d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824140:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581491.824145:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824151:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581491.824154:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824181:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581491.824188:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581491.824193:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581491.824207:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824212:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581491.824219:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824225:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb44200/0x50f0cc74b7b30f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f2f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824236:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581491.824237:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581491.824239:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581491.824245:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581491.824281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184245632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581491.824308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581491.824333:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581491.824337:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184245760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581491.824352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581491.824375:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245632 00000100:00100000:3.0:1788581491.824378:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245632 00010000:00010000:3.0:1788581491.824400:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 24 pid: 17058 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581491.824419:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245760 00000100:00100000:3.0:1788581491.824421:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245760 00010000:00010000:3.0:1788581491.824428:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 25 pid: 17056 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581491.824438:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581491.824443:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+25:3618:x1875463184245632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581491.824451:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581491.824456:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 25 pid: 17058 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824466:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 25 pid: 17058 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824477:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4e00/0x50f0cc74b7b30f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30f36 expref: 25 pid: 17058 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824489:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581491.824513:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184245632:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.824519:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581491.824529:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581491.824534:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:3618:x1875463184245760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581491.824541:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581491.824545:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824563:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581491.824714:0:19385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:611141c5-6f74-41ea-b38f-6fb1248f7899:19385:1875463184245248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788581491.824726:0:19385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788581491.824729:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581491.824731:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581491.824732:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581491.824734:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581491.824735:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581491.824742:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581491.824743:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581491.824745:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581491.824746:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788581491.824773:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5000/0x50f0cc74b7b30f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30f28 expref: 23 pid: 17056 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824784:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824792:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581491.824803:0:17050:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004939741s 00010000:00010000:3.0:1788581491.824808:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824815:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824821:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788581491.824825:0:19385:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788581491.824828:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824833:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581491.824837:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824843:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824861:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824868:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581491.824892:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3618:x1875463184245760:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581491.824899:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581491.824929:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184245760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581491.824937:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184245632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581491.824954:0:17079:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824960:0:17079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581491.824965:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b30fbb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788581491.839140:0:19385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788581491.845707:0:19385:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788581491.845718:0:19385:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788581491.845773:0:19385:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581491.845819:0:19385:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581491.845840:0:19385:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788581491.845861:0:19385:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788581491.846764:0:19385:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581491.847022:0:19385:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788581492.037760:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184245888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581492.037826:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.037888:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184245888 00000100:00100000:2.0:1788581492.037895:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184245888 00000100:00100000:2.0:1788581492.037940:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581492.037949:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184245888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581492.037977:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581492.038021:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184245888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.038028:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581492.038070:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d44070000 x1875463184245888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.038088:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184245888:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788581492.289358:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581492.549237:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184246016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581492.549334:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.549357:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581492.549371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184246144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581492.549515:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246016 00000100:00100000:3.0:1788581492.549524:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246016 00000100:00100000:1.0:1788581492.549546:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581492.549671:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246144 00000100:00100000:3.0:1788581492.549676:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246144 00000100:00100000:2.0:1788581492.549718:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581492.549732:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184246016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581492.549766:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581492.549995:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184246016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 265us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.550002:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581492.550020:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581492.550040:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184246144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581492.550058:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581492.550091:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184246144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.550097:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581492.550327:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184246144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581492.550355:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184246016:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788581492.724955:0:19451:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581492.727536:0:19451:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788581492.874808:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581472/real 1788581472] req@ffff995d43814380 x1875463184233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.874839:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43814380 x1875463184233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.874849:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581472/real 1788581472] req@ffff995d43817b80 x1875463184233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.874860:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43817b80 x1875463184233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581492.874878:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581492.874897:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581492.874901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184233472:0@lo:8:kworker.0 00000100:00080000:2.0:1788581492.874907:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581492.874912:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581492.874915:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184233600:0@lo:8:kworker.0 00000100:00080000:1.0:1788581492.875857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581492.875862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788581492.875865:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581492.875872:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1788581492.875876:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788581492.875882:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581492.875903:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43a94700 x1875463184246528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581492.875915:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581492.875918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581492.875920:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581492.875924:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1788581492.875927:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788581492.875930:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e4f27e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581492.875941:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43a96d80 x1875463184246656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581492.875967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581492.875970:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581492.875972:0:36:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581492.875977:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995d43a55000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581492.875987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d4339ce00 x1875463184247168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581492.876056:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876122:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876161:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184247552:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876200:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876224:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788581492.876230:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184246272:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876276:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876309:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184247040:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876332:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876350:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184247680:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876403:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184246400:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876425:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876442:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184247296:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876463:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876478:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184247808:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876499:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876511:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581492.876516:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184246784:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.876546:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184247424:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.876563:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.876810:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184246528:0@lo:8:kworker.0 00000100:00100000:2.0:1788581492.876843:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.876863:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184246656:0@lo:8:kworker.0 00000100:00100000:2.0:1788581492.876883:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.876910:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184247168:0@lo:8:kworker.0 00000100:00100000:2.0:1788581492.876931:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.876964:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247040 00000100:00100000:2.0:1788581492.876971:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247040 00000100:00100000:2.0:1788581492.877004:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246528 00000100:00100000:2.0:1788581492.877007:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246528 00000100:00100000:2.0:1788581492.877014:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246656 00000100:00100000:2.0:1788581492.877016:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246656 00000100:00100000:2.0:1788581492.877023:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247168 00000100:00100000:2.0:1788581492.877026:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247168 00000100:00100000:2.0:1788581492.877036:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581492.877045:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184247040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581492.877093:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184247040:12345-0@lo:400:kworker.0 Request processed in 50us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.877100:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581492.877116:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581492.877120:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184246528:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788581492.877146:0:18571:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1788581492.877186:0:18571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30fc2 00002000:00100000:2.0:1788581492.877200:0:18571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff995d42ce3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788581492.877204:0:18571:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788581492.877206:0:18571:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581492.877294:0:18571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581492.877316:0:18571:0:(import.c:65:import_set_state_nolock()) ffff995d42ce1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581492.877353:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184246528:12345-0@lo:8:kworker.0 Request processed in 230us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.877359:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581492.877373:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581492.877385:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184246656:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788581492.877400:0:18571:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1788581492.877416:0:18571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b30fc9 00002000:00100000:2.0:1788581492.877421:0:18571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff995d42ce5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788581492.877425:0:18571:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788581492.877427:0:18571:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581492.877554:0:18571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581492.877583:0:18571:0:(import.c:65:import_set_state_nolock()) ffff995d42ce6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581492.878818:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246912 00000100:00100000:1.0:1788581492.878826:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246912 00000100:00100000:1.0:1788581492.878871:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246400 00000100:00100000:1.0:1788581492.878877:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246400 00000100:00100000:1.0:1788581492.878895:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581492.878902:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184246912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.878965:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184246912:12345-0@lo:400:kworker.0 Request processed in 63us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.878972:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581492.878993:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581492.878998:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184246400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879029:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184246400:12345-0@lo:400:kworker.0 Request processed in 31us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879034:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581492.879051:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247552 00000100:00100000:1.0:1788581492.879055:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247552 00000100:00100000:1.0:1788581492.879070:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247680 00000100:00100000:1.0:1788581492.879072:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247680 00000100:00100000:1.0:1788581492.879090:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247296 00000100:00100000:1.0:1788581492.879093:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247296 00000100:00100000:1.0:1788581492.879102:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247808 00000100:00100000:1.0:1788581492.879104:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247808 00000100:00100000:1.0:1788581492.879114:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246784 00000100:00100000:1.0:1788581492.879117:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246784 00000100:00100000:1.0:1788581492.879126:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247424 00000100:00100000:1.0:1788581492.879129:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247424 00000100:00100000:1.0:1788581492.879140:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581492.879145:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184247552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879186:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184247552:12345-0@lo:400:kworker.0 Request processed in 40us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879192:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581492.879205:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581492.879211:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184247680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879239:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184247680:12345-0@lo:400:kworker.0 Request processed in 28us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879251:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581492.879292:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581492.879298:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184247296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879326:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184247296:12345-0@lo:400:kworker.0 Request processed in 29us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879332:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581492.879344:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581492.879350:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184247808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879375:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184247808:12345-0@lo:400:kworker.0 Request processed in 26us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879381:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581492.879392:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581492.879398:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879424:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184246784:12345-0@lo:400:kworker.0 Request processed in 27us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879430:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581492.879442:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581492.879448:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184247424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.879474:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184247424:12345-0@lo:400:kworker.0 Request processed in 27us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.879479:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581492.879499:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581492.879504:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875463184247168:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788581492.879529:0:18572:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1788581492.879561:0:18572:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b30fd0 00002000:00100000:1.0:1788581492.879572:0:18572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff995d4389b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788581492.879577:0:18572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788581492.879579:0:18572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788581492.879637:0:18572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788581492.879657:0:18572:0:(import.c:65:import_set_state_nolock()) ffff995d4389d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581492.879693:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184246272 00000100:00100000:0.0:1788581492.879699:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184246272 00000100:00100000:2.0:1788581492.879862:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184246656:12345-0@lo:8:kworker.0 Request processed in 2475us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581492.879868:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581492.879870:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581492.879874:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3618:x1875463184246272:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788581492.879911:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a94700 x1875463184246528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.879923:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581492.879932:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788581492.879941:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788581492.879946:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788581492.879948:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788581492.879962:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788581492.879968:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184246528:0@lo:8:kworker.0 00010000:00080000:2.0:1788581492.879982:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a96d80 x1875463184246656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.879989:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581492.879993:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788581492.879997:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788581492.880000:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788581492.880011:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788581492.880031:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788581492.880035:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184246656:0@lo:8:kworker.0 00000004:00080000:3.0:1788581492.880321:0:17090:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788581492.880342:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17090:1875463184248064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788581492.880380:0:17090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581492.880398:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581492.880404:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3618:x1875463184246272:12345-0@lo:400:kworker.0 Request processed in 36us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581492.880412:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581492.880791:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184247168:12345-0@lo:8:kworker.0 Request processed in 1283us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.880800:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581492.880813:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248064 00000100:00100000:1.0:1788581492.880819:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248064 00000100:00100000:1.0:1788581492.881054:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581492.881062:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17090:x1875463184248064:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788581492.881547:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581492.881782:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.881829:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184247936 00000100:00100000:2.0:1788581492.881834:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184247936 00000100:00100000:2.0:1788581492.881861:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581492.881869:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184247936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581492.881888:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788581492.881929:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184247936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.881935:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581492.881971:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e43279f80 x1875463184247936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581492.881989:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184247936:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788581492.884378:0:17087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788581492.884457:0:17087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479026202489ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788581492.884464:0:17087:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:1.0:1788581492.885068:0:18572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788581492.885078:0:18572:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788581492.885083:0:18572:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:2.0:1788581492.885846:0:17088:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788581492.885874:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17088:1875463184248320:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788581492.885941:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581492.885969:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268900 going to sleep for 11 seconds 00000100:00080000:2.0:1788581492.885985:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581492.885990:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581492.885993:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581492.886011:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248320 00000100:00100000:2.0:1788581492.886017:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248320 00000100:00100000:2.0:1788581492.886061:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581492.886070:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17088:x1875463184248320:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788581492.889552:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581492.889808:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581492.889883:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581492.889943:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581492.890019:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248192 00000100:00100000:3.0:1788581492.890027:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248192 00000100:00100000:3.0:1788581492.890078:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581492.890087:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184248192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581492.890110:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581492.890159:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184248192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581492.890178:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788581492.890222:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44070380 x1875463184248192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581492.890241:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184248192:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788581492.890467:0:17043:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788581492.891453:0:19099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788581492.891464:0:19099:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788581492.891471:0:19099:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1788581492.898448:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184246272:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898469:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a94e00 x1875463184247040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898482:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184247040:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898495:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339e300 x1875463184247680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898503:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184247680:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.898515:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184246912:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898549:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339c000 x1875463184247552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898557:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184247552:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898631:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a97480 x1875463184246784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898640:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184246784:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898652:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339dc00 x1875463184247424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898659:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184247424:0@lo:400:kworker.0 00000100:00100000:1.0:1788581492.898670:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184246400:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898753:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339e680 x1875463184247296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898761:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184247296:0@lo:400:kworker.0 00010000:00080000:1.0:1788581492.898773:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339fb80 x1875463184247808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.898781:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184247808:0@lo:400:kworker.0 00000004:00080000:1.0:1788581492.898811:0:17089:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581492.898894:0:17089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479040639913ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581492.898901:0:17089:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1788581492.898943:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339ce00 x1875463184247168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581492.898957:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788581492.898972:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581492.898976:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788581492.898980:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581492.899047:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581492.899053:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184247168:0@lo:8:kworker.0 00000004:00080000:1.0:1788581492.899127:0:17808:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788581492.899150:0:17808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248576:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788581492.901211:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.901247:0:17808:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581492.901291:0:18571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788581492.901301:0:18571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788581492.901548:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581492.901852:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184248448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581492.901896:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788581492.902023:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.902032:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.902047:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.902052:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.902058:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.902076:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.902088:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.902104:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.902122:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788581492.902285:0:17807:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788581492.902350:0:17807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 479044094899ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788581492.902356:0:17807:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788581492.902360:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248576 00000100:00100000:1.0:1788581492.902368:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248576 00000100:00100000:1.0:1788581492.902486:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581492.902495:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17808:x1875463184248576:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788581492.903485:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248448 00000100:00100000:3.0:1788581492.903493:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248448 00000100:00100000:3.0:1788581492.903537:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581492.903545:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1875463184248448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581492.903563:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00002000:00010000:1.0:1788581492.904905:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.904915:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.904931:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.904936:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.904942:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.904956:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.904966:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.904975:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.905004:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788581492.905438:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3618:x1875463184248448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1890us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581492.905447:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788581492.905480:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.905486:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905494:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.905499:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905521:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905541:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905549:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5029278/0x50f0cc74b7b30fd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905580:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.905584:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905590:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.905593:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905600:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905609:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905615:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363033b5/0x50f0cc74b7b30fde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.905635:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.905637:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.905639:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.905648:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581492.905957:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184248448:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788581492.906411:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788581492.907245:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.907283:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907299:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.907303:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.907309:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907322:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907332:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907338:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907359:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788581492.907543:0:17796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788581492.907849:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.907855:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907865:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.907874:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.907878:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907889:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907897:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.907905:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908039:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.908045:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908054:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.908059:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908068:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908085:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908093:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006256d191/0x50f0cc74b7b30fe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.908110:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.908112:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.908119:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.909101:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788581492.909457:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.909467:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.909479:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.909482:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.909487:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.909499:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.909508:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.909522:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581492.909691:0:17043:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788581492.911411:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.911422:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911434:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.911438:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911447:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911466:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911473:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b30fec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911492:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.911495:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911501:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6be00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.911505:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911512:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911535:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.911543:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.911544:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.911546:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.911976:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.911984:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.911996:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.912000:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.912005:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.912020:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.912030:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.912037:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.912196:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.912202:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1334c39/0x50f0cc74b7b30ff3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.912537:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.912543:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.912552:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.912556:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.912636:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.912654:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.912662:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.912664:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.912666:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.912845:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.912851:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.912860:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.912863:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.912867:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.912878:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.912885:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.912891:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913355:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.913366:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b30ffa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.913663:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.913781:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.913788:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913795:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.913799:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913806:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913820:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913826:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31001 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913840:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.913841:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.913842:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.913884:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.913889:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.913897:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.913907:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.914034:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914046:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914055:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914061:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914075:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581492.914770:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.914776:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914786:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.914789:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.914794:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914803:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914811:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914824:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914838:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581492.914845:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581492.914850:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914857:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.914861:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914869:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914881:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914887:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31008 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.914898:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.914901:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.915233:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.915237:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.915244:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.915276:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.915284:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3100f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.915295:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.915297:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.915299:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.915531:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.915538:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915547:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.915550:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.915554:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915632:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915643:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915650:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915666:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.915842:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.915847:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915855:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ba00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.915866:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915874:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915886:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915894:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ec495a6/0x50f0cc74b7b31016 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.915908:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.916025:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.916030:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916038:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.916041:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.916046:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916055:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916070:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916076:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916085:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581492.916465:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.916472:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916480:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.916482:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.916486:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916494:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916501:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916507:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.916524:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.916748:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.916753:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916760:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.916764:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916772:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916785:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916803:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b3101d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916818:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.916821:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916827:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.916830:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916838:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916848:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916855:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b31024 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.916865:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.916866:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.916868:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.916907:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.917079:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917094:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.917098:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.917103:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917113:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917121:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917128:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917141:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.917266:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.917272:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917279:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.917282:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917290:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917313:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917321:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3102b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917335:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.917338:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.917340:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.917408:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.917413:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917421:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.917424:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.917429:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917437:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917444:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917451:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917474:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.917551:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.917555:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917562:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6aa00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.917577:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917585:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917596:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917604:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001671ba14/0x50f0cc74b7b31032 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.917617:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.917619:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.917620:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.918399:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.918408:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.918559:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.918578:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.918588:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.918592:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.918596:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.918608:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.918618:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.918626:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.918640:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581492.918840:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581492.918851:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918860:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788581492.918863:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.918868:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918879:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918886:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918893:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918907:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581492.918926:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.918931:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918938:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.918942:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918950:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918970:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918978:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e636a89/0x50f0cc74b7b31039 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.918992:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.918996:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.919002:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.919006:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.919013:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.919022:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.919029:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31040 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.919040:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.919041:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.919048:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.919517:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788581492.919550:0:19464:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788581492.919555:0:19464:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788581492.919650:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17808:x1875463184248576:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17153us (18441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.919658:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581492.919833:0:17808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248576:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788581492.919847:0:17808:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788581492.919885:0:17808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248704:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788581492.919935:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.919967:0:17808:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581492.920156:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248704 00000100:00100000:3.0:1788581492.920170:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248704 00000100:00100000:3.0:1788581492.920214:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581492.920223:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:17808:x1875463184248704:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788581492.920246:0:18571:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788581492.920307:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:17808:x1875463184248704:12345-0@lo:5:osp-pre-1-1.0 Request processed in 85us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581492.920313:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581492.920429:0:17808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248704:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788581492.920438:0:17808:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788581492.920468:0:17808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248832:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788581492.920499:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.920519:0:17808:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581492.920531:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248832 00000100:00100000:1.0:1788581492.920535:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248832 00000100:00100000:1.0:1788581492.920559:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581492.920577:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:17808:x1875463184248832:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788581492.920602:0:18571:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788581492.921229:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.921244:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921303:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.921308:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.921314:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921328:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921339:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921346:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921364:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581492.921687:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.921694:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921702:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.921705:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.921710:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921720:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921734:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921742:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.921766:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581492.921796:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.921803:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921811:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.921816:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921825:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921842:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921849:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d049db99/0x50f0cc74b7b31047 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921865:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.921868:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921881:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.921885:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921892:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921904:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.921996:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e927f5c6/0x50f0cc74b7b3104e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922014:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.922017:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.922020:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.922050:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.922056:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581492.922065:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.922065:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.922068:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.922071:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922073:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922079:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788581492.922082:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.922086:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922092:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922095:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922110:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922111:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922118:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922133:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.922195:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922224:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581492.922228:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.922232:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922239:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.922242:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922250:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922281:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922289:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b3105c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922302:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.922311:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922318:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.922321:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922328:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922340:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922347:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000202e5841/0x50f0cc74b7b31055 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922361:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.922363:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.922364:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.922463:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.922470:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581492.922825:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581492.922831:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922897:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=479s v=(0 0) 00002000:00010000:2.0:1788581492.922900:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581492.922901:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.922905:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922906:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922918:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.922921:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.922924:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922935:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922936:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922944:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922945:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922953:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.922953:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922967:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581492.922972:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581492.922974:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.922977:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922983:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.922986:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.922995:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923005:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923013:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b31063 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923032:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.923036:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923042:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fc00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.923045:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923053:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923064:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923071:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338dda09/0x50f0cc74b7b3106a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.923085:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.923086:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.923088:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.923651:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.924537:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.924547:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.924561:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.924572:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.924578:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.924601:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.924611:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.924618:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581492.924626:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.924630:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.924632:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924640:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788581492.924648:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.924652:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924661:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924668:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924686:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924700:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581492.924709:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581492.924713:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924720:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.924723:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924731:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924746:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924764:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080bfaffc/0x50f0cc74b7b31071 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924782:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.924785:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924791:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.924794:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924801:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924811:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924818:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b31078 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.924828:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.924830:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.924832:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.925154:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581492.925295:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581492.925301:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.925315:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788581492.925318:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.925323:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.925334:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.925342:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.925349:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.925369:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.925399:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.925404:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925412:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.925415:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925423:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925445:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925453:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b3107f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925466:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.925468:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.925470:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.925965:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.925972:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925981:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.925985:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.925989:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.925999:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926007:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926015:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926047:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.926108:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.926221:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.926230:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6aa00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.926234:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.926242:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.926283:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.926290:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001671ba14/0x50f0cc74b7b31086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.926307:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.926308:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.926310:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.926548:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788581492.926548:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.926555:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.926556:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.926564:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.926568:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.926572:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926576:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.926579:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.926582:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926583:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926592:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.926597:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926600:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926608:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.926611:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.926624:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581492.927979:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.928016:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.928024:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928035:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.928046:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928055:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928071:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928078:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031a6ef19/0x50f0cc74b7b3108d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928094:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.928098:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928104:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.928107:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928114:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928124:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928131:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31094 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928153:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.928155:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.928157:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.928602:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788581492.928603:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.928610:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928610:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.928623:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.928623:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.928627:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.928627:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.928634:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928634:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.928646:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928646:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928655:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.928656:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.928664:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928664:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.928689:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.928694:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.928701:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.928705:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928722:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.928726:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928733:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928745:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928752:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d74059/0x50f0cc74b7b310a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928765:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.928768:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928774:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ba00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.928777:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928785:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928794:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928807:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec495a6/0x50f0cc74b7b3109b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.928820:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.928822:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.928824:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.929100:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.929106:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929115:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.929118:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.929122:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929131:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929139:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929145:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929169:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.929314:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.929319:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929331:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6be00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.929334:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929342:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929353:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929360:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1334c39/0x50f0cc74b7b310a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929373:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.929375:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.929376:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.929406:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.929416:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929424:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.929427:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.929432:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929441:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929450:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929457:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929476:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581492.929548:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581492.929554:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.929562:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ae00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581492.929571:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.929579:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.929598:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581492.929599:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.929604:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.929606:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000683bd872/0x50f0cc74b7b310b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929613:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.929616:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.929620:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.929622:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.929623:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.929625:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.929629:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929643:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929650:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.929668:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.929676:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.929680:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929687:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.929690:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929697:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929714:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929722:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.929724:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.929726:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.929755:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.929814:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c06c0cb/0x50f0cc74b7b310b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581492.929853:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.929859:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929867:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.929869:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.929873:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929882:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929890:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929897:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.929922:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581492.930089:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581492.930104:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.930111:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581492.930114:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581492.930561:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.930569:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930578:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.930582:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.930586:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930595:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930604:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930624:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930639:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.930648:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.930652:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930659:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.930663:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930821:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930838:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930846:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eba37d5/0x50f0cc74b7b310c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.930860:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.930862:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.930864:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.930998:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.931010:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931031:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.931034:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.931039:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931049:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931062:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931070:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581492.931128:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.931134:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931142:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.931144:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.931148:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931156:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931181:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931188:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.931198:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581492.931598:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931610:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931624:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b310be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931639:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581492.931642:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931648:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581492.931652:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931658:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931667:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931674:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337542f4/0x50f0cc74b7b310d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.931685:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.931687:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.931689:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.932322:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.932558:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.932565:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.932576:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.932580:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.932587:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.932601:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.932608:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d8b13ef/0x50f0cc74b7b310cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.932783:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.932826:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.932828:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.932830:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.934511:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788581492.934511:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.934521:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934522:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934537:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.934537:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.934541:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.934541:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.934548:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934548:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934561:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934570:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934571:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934579:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934580:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934587:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.934604:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.934610:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.934619:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.934623:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934630:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ee00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.934633:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934641:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934656:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934662:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a9e41a/0x50f0cc74b7b310da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.934741:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.934743:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.934745:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.934747:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.934747:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.934755:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.934758:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.934766:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.934777:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.934784:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006259682f/0x50f0cc74b7b310e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.934798:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.934799:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.934801:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.935158:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.935174:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935184:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.935193:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.935197:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935207:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935215:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935222:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935242:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.935273:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.935278:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.935297:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.935300:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.935308:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.935320:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.935327:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6b02204/0x50f0cc74b7b310e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.935340:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.935342:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.935344:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.935436:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.935442:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.935450:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.935453:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.935457:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.935466:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.935481:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.935488:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.935506:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.935525:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.935530:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935537:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ec00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.935541:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935548:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935559:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935589:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b310ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.935603:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.935605:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.935607:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.936771:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.936780:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.936790:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.936794:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.936798:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.936809:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.936816:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.936822:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.936848:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.937021:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.937028:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.937036:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.937040:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.937049:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.937070:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.937077:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e91cb0/0x50f0cc74b7b310f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.937093:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.937095:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.937097:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.937463:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.937471:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.937533:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.937536:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.937541:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.937553:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.937561:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.937567:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.937697:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788581492.938012:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.938024:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938033:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.938037:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.938041:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938050:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938057:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938064:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938079:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.938088:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.938093:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938100:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.938104:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938112:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938133:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938140:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b310fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938157:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.938160:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938180:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.938183:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938190:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938199:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938205:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.938227:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.938229:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.938238:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.939407:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.939416:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939429:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.939432:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.939438:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939449:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939458:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939465:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939483:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788581492.939829:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.939835:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939844:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.939847:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.939852:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939874:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939881:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939886:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939901:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.939909:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.939913:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939919:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.939923:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.939930:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940050:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940058:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057108f0f/0x50f0cc74b7b3110b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940079:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.940083:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940088:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.940091:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940098:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940107:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940113:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31112 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940123:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.940125:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.940126:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.940283:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.940418:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581492.940467:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581492.940474:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.940483:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788581492.940487:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581492.940490:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.940501:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.940509:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.940515:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.940543:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.940562:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.940568:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940577:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.940778:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940787:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940800:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940807:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007936de09/0x50f0cc74b7b31119 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.940822:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.940823:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.940825:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.941432:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.941440:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.941449:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.941453:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.941458:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.941467:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.941475:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.941488:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.941507:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.941550:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.941557:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.941566:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.941570:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.941578:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.941591:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.941598:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000202e5841/0x50f0cc74b7b31120 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.941612:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.941613:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.941615:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.942132:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.942139:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.942148:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.942151:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.942155:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.942184:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.942192:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.942199:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.942231:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581492.942334:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581492.942341:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.942350:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581492.942354:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.942362:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.942373:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.942381:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e927f5c6/0x50f0cc74b7b31127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581492.942395:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.942396:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581492.942398:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581492.942492:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.942498:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.942516:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.942519:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.942523:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.942533:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.942539:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.942546:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.942562:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581492.943012:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.943019:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943034:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.943037:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943045:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943057:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943064:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b3112e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943080:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.943081:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.943083:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.943385:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.943392:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943402:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.943406:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.943411:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943422:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.943439:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581492.943474:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581492.943482:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943489:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788581492.943492:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581492.943496:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943504:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943522:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943530:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943544:0:18572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.943552:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.943556:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943562:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.943566:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943573:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943583:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943590:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b3113c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.943602:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.943608:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.943610:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788581492.943652:0:18572:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788581492.943743:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17090:x1875463184248064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 62677us (63357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581492.943753:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581492.943878:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17090:1875463184248064:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788581492.943893:0:17090:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788581492.943945:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17090:1875463184248960:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788581492.943991:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581492.943997:0:17090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581492.944015:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581492.944025:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581492.944045:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184248960 00000100:00100000:3.0:1788581492.944051:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184248960 00000100:00100000:3.0:1788581492.944091:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581492.944101:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17090:x1875463184248960:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788581492.944147:0:18570:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:1.0:1788581492.944977:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.944984:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.944996:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.944999:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.945004:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945015:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945024:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945030:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945058:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581492.945069:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581492.945075:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945083:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.945087:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945096:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945110:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945118:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d049db99/0x50f0cc74b7b31135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945135:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581492.945138:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945144:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581492.945147:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945380:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945391:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945399:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e636a89/0x50f0cc74b7b31143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945416:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.945418:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581492.945420:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.945746:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.945752:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945760:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.945764:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.945768:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945777:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945785:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945803:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.945815:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581492.946042:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581492.946049:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.946059:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581492.946063:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.946072:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.946084:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.946090:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdd0377/0x50f0cc74b7b3114a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581492.946106:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.946107:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.946109:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581492.946186:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581492.946370:0:19099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581492.946377:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.946387:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788581492.946391:0:19099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581492.946395:0:19099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.946406:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.946415:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.946421:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581492.946832:0:19099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788581492.946878:0:19099:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788581492.946965:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17088:x1875463184248320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 60891us (61019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581492.946980:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581492.947034:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17088:1875463184248320:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788581492.947048:0:17088:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788581492.947091:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17088:1875463184249088:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788581492.947132:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.947160:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581492.947185:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249088 00000100:00100000:1.0:1788581492.947191:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249088 00000100:00100000:1.0:1788581492.947231:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581492.947238:0:19464:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788581492.947242:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17088:x1875463184249088:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788581492.947273:0:19464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00002000:00080000:1.0:1788581492.947433:0:19099:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1788581492.950309:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581492.950326:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.950339:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581492.950344:0:18596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.950356:0:18596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.950378:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.950385:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e9c3c6/0x50f0cc74b7b31151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581492.950405:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.950407:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581492.950409:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788581492.953134:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788581492.953180:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788581492.953185:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788581492.958286:0:18566:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788581492.958332:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788581492.958527:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17088:x1875463184249088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11282us (11389us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788581492.958537:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581492.958569:0:17088:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788581492.958586:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17088:1875463184249088:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788581492.958604:0:17088:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1788581492.960194:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17808:x1875463184248832:12345-0@lo:5:osp-pre-1-1.0 Request processed in 39621us (39686us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788581492.960206:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581492.960360:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17090:x1875463184248960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16261us (16372us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788581492.960368:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581492.960395:0:17090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788581492.960405:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17090:1875463184248960:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788581492.960419:0:17090:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1788581492.961081:0:17808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17808:1875463184248832:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788581492.961092:0:17808:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788581492.961460:0:17808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17808:1875463184249216:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788581492.961499:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581492.961529:0:17808:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e755aa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581492.961771:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249216 00000100:00100000:0.0:1788581492.961779:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249216 00000100:00100000:0.0:1788581492.961861:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581492.961870:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17808:x1875463184249216:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788581492.961930:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17808:x1875463184249216:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581492.961936:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788581492.962010:0:17808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43968e00 x1875463184249216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581508 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581492.962022:0:17808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17808:1875463184249216:0@lo:900:osp-pre-1-1.0 00000040:00080000:3.0:1788581493.314023:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788581493.319625:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788581493.506879:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788581493.506886:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7a4de800 from 10 10000000:01000000:0.0:1788581493.506892:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581493.506935:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.506945:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.506955:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581493.507235:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581493.507401:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581493.507447:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a7bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581493.507507:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249344 00000100:00100000:1.0:1788581493.507520:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249344 00000100:00100000:1.0:1788581493.507583:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788581493.507593:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184249344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581493.507613:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581493.507627:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b3115f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31158 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581493.507651:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b3115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31158 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581493.507662:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b3115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31158 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581493.507671:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb45800, rc 0) 00000100:00100000:1.0:1788581493.507718:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184249344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581493.507725:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581493.507931:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581493.507946:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.507959:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581493.508086:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788581493.508120:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581493.508151:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a7bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581493.508280:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249472 00000100:00100000:3.0:1788581493.508285:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249472 00000100:00100000:3.0:1788581493.508315:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581493.508334:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184249472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788581493.508348:0:17057:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581493.508363:0:17057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581493.508367:0:17057:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788581493.508442:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184249472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581493.508450:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581493.509428:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788581493.509503:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581493.509513:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.509522:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581493.509532:0:17060:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788581493.509534:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e4eb3d800 from 10 10000000:01000000:0.0:1788581493.509705:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581493.509731:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.509739:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.509748:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581493.509766:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581493.509823:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581493.509865:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a7bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581493.510040:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249600 00000100:00100000:2.0:1788581493.510048:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249600 00000100:00100000:2.0:1788581493.510151:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788581493.510170:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184249600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581493.510183:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581493.510196:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b3116d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31166 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581493.510215:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b3116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31166 expref: 24 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581493.510225:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b3116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31166 expref: 24 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581493.510243:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f000, rc 0) 00000100:00100000:2.0:1788581493.510302:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184249600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581493.510309:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788581493.510736:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581493.510750:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.510759:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581493.510810:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788581493.510844:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581493.510871:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a7bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581493.510963:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249728 00000100:00100000:1.0:1788581493.510968:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249728 00000100:00100000:1.0:1788581493.510992:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788581493.511000:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184249728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788581493.511014:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581493.511029:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581493.511032:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788581493.511201:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184249728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581493.511209:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788581493.511401:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184249728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788581493.511453:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581493.511460:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581493.511468:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581494.338775:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581495.361785:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581496.385438:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581497.153811:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581497.153834:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184249856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581497.153901:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581497.153963:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249856 00000100:00100000:0.0:1788581497.153971:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249856 00000100:00100000:0.0:1788581497.154037:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581497.154047:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184249856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581497.154073:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581497.154129:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184249856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581497.154145:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581497.154191:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184249856:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581497.154275:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788581497.413399:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581497.667405:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184249984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581497.667473:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581497.667683:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581497.667685:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184249984 00000100:00100000:2.0:1788581497.667693:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184249984 00000100:00100000:3.0:1788581497.667694:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184250112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581497.667736:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581497.667736:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581497.667745:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184249984:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581497.667765:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250112 00000100:00100000:3.0:1788581497.667768:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250112 00000004:00000024:2.0:1788581497.667783:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581497.667829:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184249984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581497.667907:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184249984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581497.668291:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581497.668379:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184250112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581497.668400:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581497.668445:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184250112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581497.668522:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184250112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581497.673852:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788581497.673862:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000001:02000400:1.0:1788581497.777587:0:19742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788581498.177482:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184250240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581498.177555:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.177613:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250240 00000100:00100000:3.0:1788581498.177622:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250240 00000100:00100000:3.0:1788581498.177670:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581498.177679:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184250240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581498.177706:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788581498.177749:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184250240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.177756:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788581498.177775:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581498.177807:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184250240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581498.184834:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184250368:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.184910:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.184991:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250368 00000100:00100000:3.0:1788581498.185000:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250368 00000100:00100000:3.0:1788581498.185046:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788581498.185157:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184250368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185465:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184250368:12345-0@lo:400:kworker.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.185476:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788581498.185527:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184250368:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185565:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184250496:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185593:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581498.185621:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250496 00000100:00100000:1.0:1788581498.185626:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250496 00000100:00100000:3.0:1788581498.185649:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184250624:0@lo:400:kworker.0 00000100:00100000:1.0:1788581498.185654:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581498.185661:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581498.185700:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184250496:12345-0@lo:400:kworker.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581498.185707:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581498.185712:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184250496:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185741:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184250752:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185832:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.185880:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184250880:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.185905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.185933:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250880 00000100:00100000:3.0:1788581498.185936:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250880 00000100:00100000:3.0:1788581498.185963:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581498.185969:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184250880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.186001:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184250880:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.186007:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788581498.186037:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44070380 x1875463184250880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581498.186048:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184250880:0@lo:400:kworker.0 00000100:00100000:0.0:1788581498.188061:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250624 00000100:00100000:0.0:1788581498.188071:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250624 00000100:00100000:2.0:1788581498.189558:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184251136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581498.189629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581498.189688:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184251008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581498.189713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581498.189730:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184250752 00000100:00100000:0.0:1788581498.189737:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184250752 00000100:00100000:2.0:1788581498.189760:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581498.189766:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184251264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581498.189769:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581498.189777:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184250624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581498.189803:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581498.189837:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184250624:0@lo:400:kworker.0 00000100:00100000:2.0:1788581498.189861:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251264 00000100:00100000:2.0:1788581498.189865:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251264 00000100:00100000:2.0:1788581498.189892:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581498.189898:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184251264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581498.190782:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581498.190794:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184250752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.191544:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251136 00000100:00100000:3.0:1788581498.191553:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251136 00000100:00100000:3.0:1788581498.191675:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251008 00000100:00100000:3.0:1788581498.191678:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251008 00000100:00100000:3.0:1788581498.191695:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581498.191702:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184251136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581498.191720:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581498.192722:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184250624:12345-0@lo:400:kworker.0 Request processed in 2940us (7042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581498.192734:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788581498.192907:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581498.192912:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581498.196040:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184250752:12345-0@lo:400:kworker.0 Request processed in 5238us (10197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581498.196054:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581498.196687:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184250752:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.198605:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184251136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6895us (8968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.198619:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581498.198656:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581498.198669:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184251008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581498.198694:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581498.198751:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184251008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (9031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.198757:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581498.198849:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581498.198864:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.198905:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.198939:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251648 00000100:00100000:3.0:1788581498.198946:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251648 00000100:00100000:3.0:1788581498.198989:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581498.198996:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184251648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199031:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184251648:12345-0@lo:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.199037:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788581498.199182:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581498.199244:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184251136:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788581498.199593:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814700 x1875463184251648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581498.199607:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199626:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184251392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.199692:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581498.199698:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184251520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199723:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581498.199746:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251392 00000100:00100000:3.0:1788581498.199752:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251520 00000100:00100000:0.0:1788581498.199753:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251392 00000100:00100000:3.0:1788581498.199760:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251520 00000100:00100000:0.0:1788581498.199792:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581498.199800:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581498.199805:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184251392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199813:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184251520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199851:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184251520:12345-0@lo:400:kworker.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.199858:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581498.199872:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184251392:12345-0@lo:400:kworker.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581498.199881:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788581498.199896:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43816680 x1875463184251520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581498.199906:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184251520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199916:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184251392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199962:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581498.199969:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.199992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.200015:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251776 00000100:00100000:3.0:1788581498.200019:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251776 00000100:00100000:1.0:1788581498.200097:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184251008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581498.200151:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581498.200158:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184251776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.200200:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184251776:12345-0@lo:400:kworker.0 Request processed in 42us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581498.200206:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788581498.200219:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814380 x1875463184251776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581498.200228:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.200562:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581498.200571:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184251904:0@lo:400:kworker.0 00000100:00080000:0.0:1788581498.200588:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581498.200602:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581498.200706:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581498.200714:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581498.200738:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581498.202309:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184251264:12345-0@lo:400:kworker.0 Request processed in 12403us (12509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581498.202322:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581498.202721:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184251264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581498.204173:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184251904 00000100:00100000:0.0:1788581498.204186:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184251904 00000100:00100000:2.0:1788581498.204251:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252032 00000100:00100000:2.0:1788581498.204276:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252032 00000100:00100000:0.0:1788581498.204322:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581498.204332:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184251904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581498.204407:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184251904:12345-0@lo:400:kworker.0 Request processed in 77us (3805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581498.204413:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788581498.204432:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43814380 x1875463184251904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581498.204447:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184251904:0@lo:400:kworker.0 00000100:00080000:1.0:1788581498.206999:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581498.207008:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581498.207714:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788581498.207727:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184252032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581498.207829:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184252032:12345-0@lo:400:kworker.0 Request processed in 105us (7090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581498.207844:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788581498.207893:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43836300 x1875463184252032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581498.207907:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184252032:0@lo:400:kworker.0 00010000:00010000:0.0:1788581498.433496:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788581498.688774:0:19795:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581498.689013:0:19795:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1788581498.697646:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:1.0:1788581499.426117:0:19845:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581499.426365:0:19845:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581499.459519:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581499.666612:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.666805:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541056 00000100:00100000:3.0:1788581499.666814:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541056 00000100:00100000:3.0:1788581499.666864:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:3.0:1788581499.666872:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875463170541056:12345-192.168.203.3@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788581499.666899:0:17057:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fcfe639d-128f-4392-a76c-783d2d1f3cef@192.168.203.3@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788581499.666927:0:17057:0:(genops.c:1385:class_connect()) connect: client fcfe639d-128f-4392-a76c-783d2d1f3cef, cookie 0x50f0cc74b7b31174 00000100:00080000:3.0:1788581499.667060:0:17057:0:(import.c:65:import_set_state_nolock()) ffff995e773f3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581499.667149:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+5:2392:x1875463170541056:12345-192.168.203.3@tcp:250:mount.lustre.0 Request processed in 277us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.667157:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1788581499.670357:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.670733:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541184 00000100:00100000:3.0:1788581499.670742:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541184 00000100:00100000:3.0:1788581499.670808:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1788581499.670818:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+5:14873:x1875463170541184:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581499.670836:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581499.670852:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f981400/0x50f0cc74b7b3117b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df2239f expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.670879:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f981400/0x50f0cc74b7b3117b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2239f expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.670890:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f981400/0x50f0cc74b7b3117b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2239f expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.670899:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981400, rc 0) 00000100:00100000:3.0:1788581499.670967:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+6:14873:x1875463170541184:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 151us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.670974:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1788581499.676051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.676168:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541312 00000100:00100000:1.0:1788581499.676178:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541312 00000100:00100000:1.0:1788581499.676234:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:1.0:1788581499.676248:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+6:14873:x1875463170541312:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788581499.676429:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+6:14873:x1875463170541312:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 185us (386us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581499.676439:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:0.0:1788581499.683879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581499.684306:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541440 00000100:00100000:2.0:1788581499.684317:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541440 00000100:00100000:2.0:1788581499.684372:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:2.0:1788581499.684382:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+6:14873:x1875463170541440:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581499.684396:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581499.684413:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e600/0x50f0cc74b7b31182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df223a6 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.684436:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e600/0x50f0cc74b7b31182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223a6 expref: 7 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.684446:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e600/0x50f0cc74b7b31182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223a6 expref: 7 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.684456:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e600, rc 0) 00000100:00100000:2.0:1788581499.684727:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+7:14873:x1875463170541440:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 345us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581499.684735:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:2.0:1788581499.687885:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.687998:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541568 00000100:00100000:3.0:1788581499.688009:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541568 00000100:00100000:3.0:1788581499.688067:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:3.0:1788581499.688079:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+7:14873:x1875463170541568:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788581499.688857:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14873:x1875463170541568:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 777us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.688868:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:1.0:1788581499.692948:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.693053:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541696 00000100:00100000:3.0:1788581499.693076:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541696 00000100:00100000:3.0:1788581499.693186:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1788581499.693196:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14873:x1875463170541696:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788581499.693364:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14873:x1875463170541696:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 168us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.693372:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:1.0:1788581499.698055:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.698361:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541824 00000100:00100000:3.0:1788581499.698371:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541824 00000100:00100000:3.0:1788581499.698424:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1788581499.698434:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170541824:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581499.698856:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170541824:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 421us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.698863:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:0.0:1788581499.740793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.740892:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170541952 00000100:00100000:3.0:1788581499.740904:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170541952 00000100:00100000:3.0:1788581499.740960:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:3.0:1788581499.740973:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170541952:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581499.741139:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170541952:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 168us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.741147:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1788581499.750864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.758280:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542080 00000100:00100000:3.0:1788581499.758307:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542080 00000100:00100000:3.0:1788581499.758379:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:3.0:1788581499.758391:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170542080:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581499.758714:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14891:x1875463170542080:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 324us (7858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.758728:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1788581499.767235:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581499.770426:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542208 00000100:00100000:2.0:1788581499.770443:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542208 00000100:00100000:2.0:1788581499.770797:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:2.0:1788581499.770811:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:14873:x1875463170542208:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581499.770828:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581499.770846:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df223d7 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.770875:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223d7 expref: 9 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.770886:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223d7 expref: 9 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581499.770895:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0fe00, rc 0) 00000100:00100000:2.0:1788581499.770971:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+9:14873:x1875463170542208:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 164us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581499.770978:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:0.0:1788581499.780061:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.780157:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542336 00000100:00100000:1.0:1788581499.780167:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542336 00000100:00100000:1.0:1788581499.780221:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1788581499.780232:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+9:14873:x1875463170542336:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788581499.780280:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788581499.780315:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788581499.780320:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788581499.780324:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788581499.780327:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788581499.780329:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788581499.782487:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+9:14873:x1875463170542336:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 2247us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.782511:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:2.0:1788581499.798323:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.798416:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542464 00000100:00100000:3.0:1788581499.798426:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542464 00000100:00100000:3.0:1788581499.798485:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:3.0:1788581499.798497:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+9:14873:x1875463170542464:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581499.798516:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581499.798535:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df223de expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.798574:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 10 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.798586:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 10 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581499.798595:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980000, rc 0) 00000100:00100000:3.0:1788581499.798653:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14873:x1875463170542464:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 158us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.798661:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:0.0:1788581499.809899:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.811104:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542592 00000100:00100000:3.0:1788581499.811127:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542592 00000100:00100000:3.0:1788581499.811201:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1788581499.811213:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14873:x1875463170542592:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788581499.812410:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14873:x1875463170542592:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 1191us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.812423:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1788581499.824772:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.824846:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542720 00000100:00100000:1.0:1788581499.824856:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542720 00000100:00100000:1.0:1788581499.824917:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1788581499.824927:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6b14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14873:x1875463170542720:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788581499.825515:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6b14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14873:x1875463170542720:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 588us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581499.825525:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1788581499.833893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.834347:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542848 00000100:00100000:3.0:1788581499.834358:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542848 00000100:00100000:3.0:1788581499.834422:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1788581499.834432:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14893:x1875463170542848:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581499.834792:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14893:x1875463170542848:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 360us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.834801:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1788581499.840085:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.840803:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170542976 00000100:00100000:1.0:1788581499.840826:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170542976 00000100:00100000:1.0:1788581499.840888:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:1.0:1788581499.840898:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14893:x1875463170542976:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581499.841114:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:14893:x1875463170542976:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 198us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581499.841131:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000040:00080000:0.0:1788581499.848942:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788581499.862391:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.863974:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543104 00000100:00100000:3.0:1788581499.863989:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543104 00000100:00100000:3.0:1788581499.864048:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1788581499.864057:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875463170543104:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788581499.864087:0:17063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1788581499.864151:0:17063:0:(genops.c:1385:class_connect()) connect: client e62527f4-3622-4ebf-800d-388b643273eb, cookie 0x50f0cc74b7b31197 00000004:00100000:3.0:1788581499.864176:0:17063:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788581499.864455:0:17063:0:(import.c:65:import_set_state_nolock()) ffff995e773f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581499.864544:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:2392:x1875463170543104:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 484us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.865487:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581499.868186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.868301:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543360 00000100:00100000:3.0:1788581499.868312:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543360 00000100:00100000:3.0:1788581499.868349:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1788581499.868358:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875463170543360:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788581499.868415:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1788581499.868476:0:17065:0:(genops.c:1385:class_connect()) connect: client e62527f4-3622-4ebf-800d-388b643273eb, cookie 0x50f0cc74b7b3119e 00000004:00100000:3.0:1788581499.868511:0:17065:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788581499.869000:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995e773f3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581499.869079:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2392:x1875463170543360:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 720us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.869087:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581499.891138:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581499.891182:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581499.891217:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.891342:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543232 00000100:00100000:3.0:1788581499.891352:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543232 00000100:00100000:3.0:1788581499.891416:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543488 00000100:00100000:3.0:1788581499.891419:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543488 00000100:00100000:3.0:1788581499.891432:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543616 00000100:00100000:3.0:1788581499.891435:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543616 00000100:00100000:3.0:1788581499.891450:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581499.891458:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+7:0:x1875463170543232:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581499.891496:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788581499.891772:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+7:0:x1875463170543232:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 313us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.891780:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581499.891798:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581499.891804:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:0:x1875463170543488:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581499.891822:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581499.891858:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:0:x1875463170543488:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 53us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.891865:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581499.891878:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1788581499.891896:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170543616:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581499.891907:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788581499.891928:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170543616:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.891934:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00080000:2.0:1788581499.892882:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581499.892888:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581499.897947:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.898045:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543744 00000100:00100000:3.0:1788581499.898056:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543744 00000100:00100000:3.0:1788581499.898134:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581499.898145:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170543744:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788581499.898232:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170543744:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.898239:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1788581499.908657:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.908696:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581499.908727:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581499.908959:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170543872 00000100:00100000:3.0:1788581499.908969:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170543872 00000100:00100000:3.0:1788581499.909013:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544000 00000100:00100000:3.0:1788581499.909016:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544000 00000100:00100000:3.0:1788581499.909037:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581499.909045:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170543872:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581499.909076:0:18572:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1788581499.909106:0:18572:0:(genops.c:1385:class_connect()) connect: client e62527f4-3622-4ebf-800d-388b643273eb, cookie 0x50f0cc74b7b311a5 00002000:00100000:3.0:1788581499.909129:0:18572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e62527f4-3622-4ebf-800d-388b643273eb/ffff995e773f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581499.909146:0:18572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581499.909362:0:18572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581499.909393:0:18572:0:(import.c:65:import_set_state_nolock()) ffff995e773f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581499.909451:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2392:x1875463170543872:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 404us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581499.909471:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581499.909489:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581499.909493:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170544000:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581499.909523:0:18572:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000100:00100000:0.0:1788581499.909630:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544128 00000100:00100000:0.0:1788581499.909636:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544128 00000100:00100000:0.0:1788581499.909674:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1788581499.909683:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170544128:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788581499.909724:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170544128:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 43us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581499.909741:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000020:00000080:0.0:1788581499.910757:0:18572:0:(genops.c:1385:class_connect()) connect: client e62527f4-3622-4ebf-800d-388b643273eb, cookie 0x50f0cc74b7b311ac 00002000:00100000:0.0:1788581499.910772:0:18572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e62527f4-3622-4ebf-800d-388b643273eb/ffff995e4f10e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581499.910788:0:18572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788581499.910945:0:18572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788581499.910976:0:18572:0:(import.c:65:import_set_state_nolock()) ffff995d43b10800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581499.911035:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2392:x1875463170544000:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 1539us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581499.911043:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581499.919682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581499.920725:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544256 00000100:00100000:2.0:1788581499.920737:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544256 00000100:00100000:2.0:1788581499.920796:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581499.920807:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170544256:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788581499.922901:0:17066:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1995us 00000004:00200000:2.0:1788581499.980984:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788581499.981143:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:14873:x1875463170544256:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 60332us (61465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581499.981155:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581500.203230:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581500.207509:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544384 00000100:00100000:1.0:1788581500.207526:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544384 00000100:00100000:1.0:1788581500.207596:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581500.207608:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:14916:x1875463170544384:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788581500.207629:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581500.207654:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44200/0x50f0cc74b7b311b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2240f expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207726:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207740:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207756:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581500.207821:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581500.207825:0:17063:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581500.207859:0:17063:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207885:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44200/0x50f0cc74b7b311b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2240f expref: 8 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207904:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2240f expref: 7 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581500.207913:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:1.0:1788581500.207916:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581500.207919:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44a00, rc 0) 00000100:00100000:1.0:1788581500.207993:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+7:14916:x1875463170544384:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 387us (4771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581500.208001:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00010000:00010000:2.0:1788581500.483732:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581501.506948:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581502.180625:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.180915:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544512 00000100:00100000:0.0:1788581502.180927:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544512 00000100:00100000:0.0:1788581502.181224:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1788581502.181235:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+7:14969:x1875463170544512:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:0.0:1788581502.181321:0:17064:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788581502.181433:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+7:14969:x1875463170544512:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 199us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581502.181441:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:2.0:1788581502.182395:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581502.185349:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.185453:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544640 00000100:00100000:1.0:1788581502.185463:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544640 00000100:00100000:1.0:1788581502.185537:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1788581502.185548:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544640:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:1.0:1788581502.185586:0:17063:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581502.185713:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544640:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 164us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.185720:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:2.0:1788581502.186422:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581502.188305:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.188605:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544768 00000100:00100000:0.0:1788581502.188615:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544768 00000100:00080000:2.0:1788581502.188735:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581502.188779:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1788581502.188791:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544768:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1788581502.188823:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581502.188910:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544768:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 121us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581502.188928:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581502.192095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.192293:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170544896 00000100:00100000:0.0:1788581502.192303:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170544896 00000100:00100000:0.0:1788581502.192375:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1788581502.192385:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544896:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1788581502.192424:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581502.192569:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e62527f4-3622-4ebf-800d-388b643273eb+6:14969:x1875463170544896:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 185us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581502.192577:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00080000:2.0:1788581502.197546:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581502.274388:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581502.274432:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184252160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581502.274502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581502.274930:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252160 00000100:00100000:3.0:1788581502.274938:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252160 00000100:00100000:3.0:1788581502.274998:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581502.275007:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184252160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581502.275031:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581502.275077:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184252160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.275085:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581502.275187:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184252160:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581502.275281:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581502.428097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.428305:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545024 00000100:00100000:3.0:1788581502.428315:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545024 00000100:00100000:3.0:1788581502.428379:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1788581502.428388:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:15002:x1875463170545024:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581502.428405:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581502.428422:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f981600/0x50f0cc74b7b311c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22416 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.428448:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f981600/0x50f0cc74b7b311c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22416 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.428458:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f981600/0x50f0cc74b7b311c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22416 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.428481:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981600, rc 0) 00000100:00100000:3.0:1788581502.428637:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545024:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 248us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.428644:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:0.0:1788581502.435233:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.435350:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545152 00000100:00100000:2.0:1788581502.435360:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545152 00000100:00100000:2.0:1788581502.435414:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:2.0:1788581502.435424:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545152:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581502.442222:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545152:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 6781us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.442238:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1788581502.453437:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.454970:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545280 00000100:00100000:1.0:1788581502.454983:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545280 00000100:00100000:1.0:1788581502.455059:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1788581502.455080:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545280:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788581502.455437:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545280:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 357us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.455445:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1788581502.482034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.482144:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545408 00000100:00100000:2.0:1788581502.482154:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545408 00000100:00100000:2.0:1788581502.482208:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1788581502.482218:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545408:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581502.482437:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545408:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 219us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.482452:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1788581502.507384:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.507484:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545536 00000100:00100000:1.0:1788581502.507494:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545536 00000100:00100000:1.0:1788581502.507558:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:1.0:1788581502.507570:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545536:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581502.507758:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545536:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 188us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.507766:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:0.0:1788581502.511703:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.511800:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545664 00000100:00100000:3.0:1788581502.511811:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545664 00000100:00100000:3.0:1788581502.511866:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:3.0:1788581502.511877:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545664:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581502.512044:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15008:x1875463170545664:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 168us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.512052:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:3.0:1788581502.516804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.516905:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545792 00000100:00100000:2.0:1788581502.516915:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545792 00000100:00100000:2.0:1788581502.516965:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:2.0:1788581502.516976:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:15002:x1875463170545792:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581502.516990:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581502.517007:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b311c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22447 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581502.517036:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b311c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22447 expref: 12 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581502.517047:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b311c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22447 expref: 12 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581502.517056:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ec00, rc 0) 00000100:00100000:2.0:1788581502.517123:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:15002:x1875463170545792:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.517129:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1788581502.523003:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.523115:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170545920 00000100:00100000:1.0:1788581502.523127:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170545920 00000100:00100000:1.0:1788581502.523187:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1788581502.523200:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:15002:x1875463170545920:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788581502.523229:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788581502.523413:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788581502.523420:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788581502.523422:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788581502.523425:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788581502.523428:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00010000:00010000:0.0:1788581502.530680:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581502.532211:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:15002:x1875463170545920:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 9007us (9209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.532233:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1788581502.539832:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.539932:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546048 00000100:00100000:1.0:1788581502.539942:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546048 00000100:00100000:1.0:1788581502.539994:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:1.0:1788581502.540005:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:15002:x1875463170546048:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581502.540019:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581502.540035:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df2244e expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581502.540063:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 13 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581502.540074:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 13 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581502.540084:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44800, rc 0) 00000100:00100000:1.0:1788581502.540149:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15002:x1875463170546048:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.540156:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1788581502.547003:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.547391:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546176 00000100:00100000:1.0:1788581502.547400:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546176 00000100:00100000:1.0:1788581502.547457:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:1.0:1788581502.547467:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15002:x1875463170546176:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788581502.547630:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15002:x1875463170546176:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 163us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.547638:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:0.0:1788581502.552391:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.552492:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546304 00000100:00100000:2.0:1788581502.552502:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546304 00000100:00100000:2.0:1788581502.552562:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:2.0:1788581502.552571:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15002:x1875463170546304:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788581502.552706:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15002:x1875463170546304:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 135us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.552714:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1788581502.561075:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.564464:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546432 00000100:00100000:3.0:1788581502.564477:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546432 00000100:00100000:3.0:1788581502.564542:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1788581502.564551:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15011:x1875463170546432:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581502.564690:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15011:x1875463170546432:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 139us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.564697:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:0.0:1788581502.570930:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.571020:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546560 00000100:00100000:1.0:1788581502.571039:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546560 00000100:00100000:1.0:1788581502.571094:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1788581502.571114:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15011:x1875463170546560:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581502.571392:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e5231bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:15011:x1875463170546560:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 287us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.571400:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:0.0:1788581502.596007:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.596050:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581502.596484:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546688 00000100:00100000:1.0:1788581502.596493:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546688 00000100:00100000:1.0:1788581502.596551:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546944 00000100:00100000:1.0:1788581502.596555:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546944 00000100:00100000:1.0:1788581502.596571:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581502.596578:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875463170546688:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581502.596605:0:17063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22@192.168.203.3@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1788581502.596647:0:17063:0:(genops.c:1385:class_connect()) connect: client 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22, cookie 0x50f0cc74b7b311d6 00000004:00100000:1.0:1788581502.596672:0:17063:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581502.596758:0:17063:0:(import.c:65:import_set_state_nolock()) ffff995e4f0d9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581502.596891:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2392:x1875463170546688:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 310us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.596899:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581502.596922:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581502.596927:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875463170546944:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581502.596942:0:17063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22@192.168.203.3@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1788581502.596963:0:17063:0:(genops.c:1385:class_connect()) connect: client 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22, cookie 0x50f0cc74b7b311dd 00000004:00100000:1.0:1788581502.596975:0:17063:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581502.597066:0:17063:0:(import.c:65:import_set_state_nolock()) ffff995e4f0da800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581502.597093:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2392:x1875463170546944:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 164us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581502.597110:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1788581502.609890:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.609948:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.610025:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.610221:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547200 00000100:00100000:2.0:1788581502.610231:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547200 00000100:00100000:2.0:1788581502.610314:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547072 00000100:00100000:2.0:1788581502.610318:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547072 00000100:00100000:2.0:1788581502.610331:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170546816 00000100:00100000:2.0:1788581502.610333:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170546816 00000100:00100000:2.0:1788581502.610346:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1788581502.610355:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+7:15002:x1875463170547200:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788581502.610385:0:17064:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581502.610449:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+7:15002:x1875463170547200:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 95us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.610457:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1788581502.610474:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1788581502.610480:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:0:x1875463170547072:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788581502.610491:0:17064:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788581502.610609:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581502.610614:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581502.610649:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:0:x1875463170547072:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 168us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.610655:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1788581502.610669:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1788581502.610676:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:0:x1875463170546816:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788581502.610686:0:17064:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581502.610707:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:0:x1875463170546816:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.610713:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1788581502.621299:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.623690:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547328 00000100:00100000:0.0:1788581502.623704:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547328 00000100:00100000:0.0:1788581502.623776:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1788581502.623786:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547328:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788581502.623880:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547328:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 94us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581502.623888:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581502.628418:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.628529:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547456 00000100:00100000:3.0:1788581502.628546:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547456 00000100:00100000:3.0:1788581502.628594:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581502.628602:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875463170547456:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581502.628645:0:18570:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22@192.168.203.3@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1788581502.628674:0:18570:0:(genops.c:1385:class_connect()) connect: client 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22, cookie 0x50f0cc74b7b311e4 00002000:00100000:3.0:1788581502.628686:0:18570:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22/ffff995d43a51000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581502.628697:0:18570:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581502.628771:0:18570:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581502.628801:0:18570:0:(import.c:65:import_set_state_nolock()) ffff995e43096800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581502.628872:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2392:x1875463170547456:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 269us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.628879:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581502.632974:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.633018:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581502.633116:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547712 00000100:00100000:0.0:1788581502.633126:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547712 00000100:00100000:0.0:1788581502.633189:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1788581502.633201:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547712:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788581502.633319:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547712:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581502.633328:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1788581502.633751:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547584 00000100:00100000:2.0:1788581502.633757:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547584 00000100:00100000:2.0:1788581502.633790:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1788581502.633796:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875463170547584:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788581502.633824:0:19464:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22@192.168.203.3@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788581502.633853:0:19464:0:(genops.c:1385:class_connect()) connect: client 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22, cookie 0x50f0cc74b7b311eb 00002000:00100000:2.0:1788581502.633865:0:19464:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22/ffff995e773f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581502.633876:0:19464:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581502.633978:0:19464:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581502.634005:0:19464:0:(import.c:65:import_set_state_nolock()) ffff995e773f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581502.634055:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2392:x1875463170547584:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 257us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.634061:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1788581502.641900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581502.644490:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547840 00000100:00100000:2.0:1788581502.644504:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547840 00000100:00100000:2.0:1788581502.644579:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1788581502.644589:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547840:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788581502.644706:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788581502.644787:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15002:x1875463170547840:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 199us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.644794:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1788581502.785677:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581502.785695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184252416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581502.785696:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184252288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581502.785777:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581502.785927:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581502.785979:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252288 00000100:00100000:3.0:1788581502.785987:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252288 00000100:00100000:3.0:1788581502.786034:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252416 00000100:00100000:3.0:1788581502.786036:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252416 00000100:00100000:3.0:1788581502.786049:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581502.786055:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184252288:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581502.786096:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581502.786118:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184252416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581502.786142:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1788581502.786147:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581502.786203:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184252416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.786209:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184252288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581502.786215:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788581502.786229:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581502.786310:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184252416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581502.786478:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184252288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581502.863630:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581502.863759:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170547968 00000100:00100000:3.0:1788581502.863779:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170547968 00000100:00100000:3.0:1788581502.863837:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1788581502.863847:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15034:x1875463170547968:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:3.0:1788581502.863866:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581502.863888:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b311f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2247f expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.863953:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.863967:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.863982:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581502.864029:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581502.864033:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581502.864054:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.864250:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b311f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 8 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.864359:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 7 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581502.864369:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:3.0:1788581502.864371:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581502.864375:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981200, rc 0) 00000100:00100000:3.0:1788581502.864441:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+7:15034:x1875463170547968:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 596us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581502.864448:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1788581503.297497:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581503.297520:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184252544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581503.297602:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.297898:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184252800:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.297928:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.297957:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184253312:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.297982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.297997:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184253824:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298024:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298043:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788581503.298048:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184252672:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298092:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298125:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298148:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298162:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184253696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298185:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298213:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252800 00000100:00100000:2.0:1788581503.298219:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252800 00000100:00100000:2.0:1788581503.298285:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253184 00000100:00100000:2.0:1788581503.298288:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253184 00000100:00100000:2.0:1788581503.298323:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581503.298330:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184252800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298384:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184252800:12345-0@lo:400:kworker.0 Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581503.298391:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581503.298408:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581503.298414:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184253184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298442:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184253184:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581503.298448:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581503.298482:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298491:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184252800:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298516:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298539:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298555:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184253440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298617:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298633:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184253952:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298672:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298691:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581503.298696:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184253056:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298719:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298729:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184253568:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298747:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298757:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184254080:0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298786:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581503.298807:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252672 00000100:00100000:2.0:1788581503.298810:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252672 00000100:00100000:2.0:1788581503.298835:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788581503.298842:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3619:x1875463184252672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581503.298876:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3619:x1875463184252672:12345-0@lo:400:kworker.0 Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581503.298882:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788581503.298912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184252672:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299007:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253312 00000100:00100000:0.0:1788581503.299012:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253312 00000100:00100000:0.0:1788581503.299049:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252928 00000100:00100000:0.0:1788581503.299052:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252928 00000100:00100000:0.0:1788581503.299080:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253440 00000100:00100000:0.0:1788581503.299083:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253440 00000100:00100000:0.0:1788581503.299117:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581503.299124:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184253312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299162:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184253312:12345-0@lo:400:kworker.0 Request processed in 40us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299174:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581503.299189:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581503.299194:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184252928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299221:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184252928:12345-0@lo:400:kworker.0 Request processed in 28us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299227:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581503.299237:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581503.299242:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184253440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299283:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184253440:12345-0@lo:400:kworker.0 Request processed in 41us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299289:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788581503.299303:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581503.299306:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581503.299327:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184253312:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299343:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184252544 00000100:00100000:0.0:1788581503.299346:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184252544 00000100:00100000:0.0:1788581503.299370:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581503.299376:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184252544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581503.299388:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581503.299416:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184252544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299420:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788581503.299431:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581503.299447:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184252928:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299453:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788581503.299469:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184253440:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299486:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184252544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581503.299506:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253824 00000100:00100000:0.0:1788581503.299509:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253824 00000100:00100000:0.0:1788581503.299532:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253696 00000100:00100000:0.0:1788581503.299534:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253696 00000100:00100000:0.0:1788581503.299544:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253952 00000100:00100000:0.0:1788581503.299545:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253952 00000100:00100000:0.0:1788581503.299555:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253056 00000100:00100000:0.0:1788581503.299557:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253056 00000100:00100000:0.0:1788581503.299566:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184253568 00000100:00100000:0.0:1788581503.299568:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184253568 00000100:00100000:0.0:1788581503.299576:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254080 00000100:00100000:0.0:1788581503.299578:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254080 00000100:00100000:0.0:1788581503.299590:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581503.299595:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184253824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299628:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184253824:12345-0@lo:400:kworker.0 Request processed in 33us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299634:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581503.299645:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581503.299650:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184253696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299674:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184253696:12345-0@lo:400:kworker.0 Request processed in 24us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299679:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581503.299689:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581503.299693:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184253952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299718:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184253952:12345-0@lo:400:kworker.0 Request processed in 24us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299729:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581503.299741:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581503.299746:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184253056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299772:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184253056:12345-0@lo:400:kworker.0 Request processed in 26us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299778:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581503.299788:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581503.299793:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184253568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299813:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184253568:12345-0@lo:400:kworker.0 Request processed in 21us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299818:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581503.299827:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581503.299831:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184254080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299853:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184254080:12345-0@lo:400:kworker.0 Request processed in 21us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.299858:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788581503.299871:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581503.299873:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581503.299890:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184253696:0@lo:400:kworker.0 00010000:00080000:0.0:1788581503.299902:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb37b80 x1875463184253824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581503.299911:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184253824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299933:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299953:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184253568:0@lo:400:kworker.0 00010000:00080000:0.0:1788581503.299967:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb34700 x1875463184254080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581503.299974:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184254080:0@lo:400:kworker.0 00000100:00100000:0.0:1788581503.299984:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184253952:0@lo:400:kworker.0 00000100:00100000:1.0:1788581503.300394:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581503.300407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184254208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581503.300441:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581503.300471:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254208 00000100:00100000:1.0:1788581503.300475:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254208 00000100:00100000:1.0:1788581503.300501:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581503.300508:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184254208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788581503.300519:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788581503.300565:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184254208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581503.300571:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581503.300609:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184254208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581503.301153:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581503.301167:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581503.301200:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581503.301276:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254336 00000100:00100000:0.0:1788581503.301281:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254336 00000100:00100000:0.0:1788581503.301351:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581503.301359:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581503.301372:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581503.301420:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581503.301427:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581503.303642:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254336:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788581503.553943:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788581503.554346:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581504.577524:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581505.601803:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788581505.873181:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:1.0:1788581505.873194:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:00100000:1.0:1788581505.873574:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:1.0:1788581505.873580:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:00100000:0.0:1788581505.873729:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:0.0:1788581505.873741:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:00100000:0.0:1788581505.875552:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:0.0:1788581505.875567:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:02000400:1.0:1788581506.032913:0:19943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788581506.626647:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581507.395474:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184254464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581507.395761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581507.395867:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254464 00000100:00100000:2.0:1788581507.395876:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254464 00000100:00100000:3.0:1788581507.396228:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581507.396240:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184254464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581507.396293:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581507.396340:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184254464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.396348:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581507.396394:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184254464:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581507.396573:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581507.652688:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581507.817084:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817176:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817209:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817293:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817316:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817336:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817354:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817373:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817390:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581507.817417:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548352 00000100:00100000:3.0:1788581507.817426:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548352 00000100:00100000:3.0:1788581507.817509:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548864 00000100:00100000:3.0:1788581507.817525:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548864 00000100:00100000:3.0:1788581507.817543:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548224 00000100:00100000:3.0:1788581507.817545:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548224 00000100:00100000:3.0:1788581507.817556:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548736 00000100:00100000:3.0:1788581507.817558:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548736 00000100:00100000:3.0:1788581507.817574:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1788581507.817583:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.817648:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.817655:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1788581507.817670:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1788581507.817676:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170548864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.817695:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170548864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.817701:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1788581507.817710:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581507.817716:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2393:x1875463170548224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.817733:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2393:x1875463170548224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 18us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.817738:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581507.817747:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1788581507.817753:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2393:x1875463170548736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.817772:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2393:x1875463170548736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.817778:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1788581507.817884:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548608 00000100:00100000:3.0:1788581507.817887:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548608 00000100:00100000:2.0:1788581507.817895:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549120 00000100:00100000:2.0:1788581507.817902:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549120 00000100:00100000:3.0:1788581507.817916:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548480 00000100:00100000:3.0:1788581507.817920:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548480 00000100:00100000:2.0:1788581507.817939:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548992 00000100:00100000:2.0:1788581507.817944:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548992 00000100:00100000:3.0:1788581507.817945:0:19467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1788581507.817956:0:19467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581507.817974:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581507.817985:0:19467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.817990:0:19467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581507.818004:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170549120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.818005:0:19467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581507.818016:0:19467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581507.818053:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170549120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 70us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581507.818217:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1788581507.818232:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581507.818248:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170548992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581507.818543:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170548096 00000100:00100000:1.0:1788581507.818562:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170548096 00000100:00100000:1.0:1788581507.818960:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:1.0:1788581507.818976:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2393:x1875463170548096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581507.819144:0:19467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170548480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1128us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.819153:0:19467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00080000:3.0:1788581507.819174:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581507.819179:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581507.819182:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581507.819185:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581507.819591:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170548992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1348us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581507.819599:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1788581507.820532:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2393:x1875463170548096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1551us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581507.820542:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:0.0:1788581507.906083:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581507.906118:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184254592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581507.906206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581507.907516:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254592 00000100:00100000:3.0:1788581507.907527:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254592 00000100:00100000:3.0:1788581507.907575:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581507.907586:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184254592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581507.907618:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788581507.907690:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184254592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.907698:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581507.907763:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581507.907820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581507.907863:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254720 00000100:00100000:3.0:1788581507.907867:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254720 00000100:00100000:3.0:1788581507.907889:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581507.907897:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581507.907914:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581507.907948:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581507.907954:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581507.907991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581507.908025:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184254592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581508.417461:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581508.417486:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581508.417598:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.417786:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184255104:0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.417821:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184255360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.417844:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.417859:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.417884:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.417890:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.417915:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.417933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.417941:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.417960:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788581508.417968:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.417975:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.418003:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788581508.418010:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184254976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581508.418015:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.418037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184255744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418045:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.418079:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418080:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.418099:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184256256:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418111:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.418133:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581508.418136:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184256000:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418162:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.418166:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254848 00000100:00100000:3.0:1788581508.418174:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254848 00000100:00100000:0.0:1788581508.418190:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255104 00000100:00100000:0.0:1788581508.418194:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255104 00000100:00100000:3.0:1788581508.418224:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184254976 00000100:00100000:0.0:1788581508.418236:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581508.418238:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184254976 00000100:00100000:0.0:1788581508.418247:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3621:x1875463184255104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418285:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581508.418293:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581508.418318:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581508.418330:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3621:x1875463184255104:12345-0@lo:400:kworker.0 Request processed in 85us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418340:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788581508.418358:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184254848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581508.418365:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581508.418381:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255616 00000100:00100000:3.0:1788581508.418386:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581508.418387:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255616 00000100:00100000:3.0:1788581508.418395:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184254976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581508.418407:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581508.418420:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255232 00000100:00100000:0.0:1788581508.418425:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255232 00000100:00100000:3.0:1788581508.418437:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184254976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581508.418445:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581508.418457:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255488 00000100:00100000:0.0:1788581508.418462:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255488 00000100:00100000:0.0:1788581508.418489:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581508.418496:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418501:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255360 00000100:00100000:3.0:1788581508.418506:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255360 00000100:00100000:0.0:1788581508.418534:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184255616:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418541:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581508.418543:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255872 00000100:00100000:3.0:1788581508.418547:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255872 00000100:00100000:0.0:1788581508.418560:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581508.418568:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256128 00000100:00100000:0.0:1788581508.418570:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184255232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418573:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256128 00000100:00100000:3.0:1788581508.418595:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184255744 00000100:00100000:3.0:1788581508.418598:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184255744 00000100:00100000:3.0:1788581508.418612:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256256 00000100:00100000:0.0:1788581508.418614:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184255232:12345-0@lo:400:kworker.0 Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581508.418616:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256256 00000100:00100000:0.0:1788581508.418625:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581508.418633:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256000 00000100:00100000:3.0:1788581508.418637:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256000 00000100:00100000:0.0:1788581508.418643:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581508.418654:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418658:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788581508.418669:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184255360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418687:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184255488:12345-0@lo:400:kworker.0 Request processed in 36us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418694:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581508.418713:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184255360:12345-0@lo:400:kworker.0 Request processed in 45us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418715:0:17064:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581508.418723:0:17064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788581508.418733:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788581508.418747:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581508.418754:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581508.418758:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184255872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418768:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184256128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418798:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184255872:12345-0@lo:400:kworker.0 Request processed in 43us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418805:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581508.418812:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184256128:12345-0@lo:400:kworker.0 Request processed in 48us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418819:0:17063:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788581508.418820:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581508.418832:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581508.418841:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581508.418842:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581508.418851:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581508.418862:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184256256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.418895:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184255744:12345-0@lo:400:kworker.0 Request processed in 55us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418907:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581508.418908:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184256256:12345-0@lo:400:kworker.0 Request processed in 45us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581508.418916:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788581508.418925:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581508.418935:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184256000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788581508.418938:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581508.418944:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581508.418947:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581508.418950:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581508.418965:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184256000:12345-0@lo:400:kworker.0 Request processed in 32us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581508.418970:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581508.419119:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581508.419152:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419162:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184255744:0@lo:400:kworker.0 00010000:00080000:0.0:1788581508.419173:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb37480 x1875463184256256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581508.419182:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184256256:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419192:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184255360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419201:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419229:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184254976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581508.419237:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184255488:0@lo:400:kworker.0 00010000:00080000:0.0:1788581508.419247:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e7fb35f80 x1875463184256000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581508.419390:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184256000:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419409:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184255104:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419419:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184255616:0@lo:400:kworker.0 00000100:00100000:0.0:1788581508.419428:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184256128:0@lo:400:kworker.0 00000100:00100000:2.0:1788581508.420524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184256384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581508.420583:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581508.421667:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256384 00000100:00100000:3.0:1788581508.421677:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256384 00000100:00100000:3.0:1788581508.421724:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581508.421735:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184256384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581508.421757:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788581508.423251:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184256384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1511us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581508.423277:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581508.425563:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184256384:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788581508.681190:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581509.063469:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788581509.474318:0:20091:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc62c928c0 20000000:00000080:0.0:1788581509.474335:0:20091:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e7f61cc00 uarg=0000000000000000 20000000:01000000:0.0:1788581509.474388:0:20091:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581509.474394:0:20091:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581509.474398:0:20091:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788581509.478147:0:20092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788581509.478284:0:20091:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788581509.490455:0:20091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788581509.490624:0:20091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490643:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490650:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490656:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490662:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490670:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 12 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490676:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490682:0:20091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490723:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490737:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 12 pid: 17056 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.490753:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256512:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581509.490863:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 12 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.490872:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 12 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.490881:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256640:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581509.491173:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.491183:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.491193:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256768:0@lo:104: 00000100:00100000:3.0:1788581509.491579:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581509.491661:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 23 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.491670:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 23 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.491678:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256896:0@lo:104: 00000100:00100000:3.0:1788581509.491701:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581509.491842:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.491850:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.491859:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184257024:0@lo:104: 00000100:00100000:3.0:1788581509.491891:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581509.492001:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256768 00000100:00100000:1.0:1788581509.492009:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256768 00000100:00100000:1.0:1788581509.492073:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184256896 00000100:00100000:1.0:1788581509.492077:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184256896 00000100:00100000:1.0:1788581509.492092:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581509.492101:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:20091:x1875463184256768:12345-0@lo:104: 00010000:00010000:1.0:1788581509.492114:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492168:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581509.492174:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:20091:x1875463184256768:12345-0@lo:104: Request processed in 75us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581509.492181:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581509.492203:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581509.492219:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:20091:x1875463184256896:12345-0@lo:104: 00010000:00010000:1.0:1788581509.492226:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492288:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581509.492294:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:20091:x1875463184256896:12345-0@lo:104: Request processed in 86us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581509.492300:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788581509.492318:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581509.492329:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492336:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581509.492340:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492348:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581509.492355:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581509.492361:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581509.492399:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492406:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581509.492424:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492431:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f980400/0x50f0cc74b7b30f75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30f7c expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492445:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581509.492448:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492453:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581509.492456:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492483:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581509.492489:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581509.492494:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581509.492510:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492516:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581509.492521:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581509.492523:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492531:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5200/0x50f0cc74b7b30edb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ee2 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.492540:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581509.492542:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581509.492544:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581509.492549:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184257152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581509.492583:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184257280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581509.492589:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581509.492622:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581509.492646:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257152 00000100:00100000:2.0:1788581509.492650:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257152 00000100:00100000:1.0:1788581509.492667:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257280 00010000:00010000:2.0:1788581509.492672:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 24 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581509.492674:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257280 00010000:00010000:1.0:1788581509.492692:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 25 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581509.492701:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581509.492710:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+25:3620:x1875463184257152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581509.492719:0:17049:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788581509.492722:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788581509.492728:0:17049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788581509.492731:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 25 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.492746:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 25 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.492762:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581509.492792:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+25:3620:x1875463184257152:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581509.492810:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581509.492826:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581509.492833:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3621:x1875463184257280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581509.492842:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581509.492847:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 24 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.492855:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 24 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.492867:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581509.492901:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3621:x1875463184257280:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581509.492907:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581509.492946:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184257152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581509.492970:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184257280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581509.494146:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.494161:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.494174:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184257408:0@lo:104: 00000100:00100000:3.0:1788581509.494214:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581509.494227:0:20091:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512e6240 going to sleep for 11 seconds 00010000:00010000:3.0:1788581509.494247:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5600/0x50f0cc74b7b30f7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30f75 expref: 23 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.494281:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256768:0@lo:104: 00010000:00010000:3.0:1788581509.494292:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b30ee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30edb expref: 22 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.494300:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256896:0@lo:104: 00000100:00100000:1.0:1788581509.494375:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257024 00000100:00100000:1.0:1788581509.494381:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257024 00000100:00100000:1.0:1788581509.494744:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257408 00000100:00100000:1.0:1788581509.494748:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257408 00000100:00100000:1.0:1788581509.494762:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581509.494770:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:20091:x1875463184257024:12345-0@lo:104: 00000100:00100000:2.0:1788581509.495473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581509.495517:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581509.495550:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549248 00000100:00100000:2.0:1788581509.495555:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549248 00010000:00010000:2.0:1788581509.495582:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 13 pid: 17056 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581509.495607:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549376 00000100:00100000:2.0:1788581509.495609:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549376 00010000:00010000:2.0:1788581509.495619:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 14 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581509.495662:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1788581509.495673:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcfe639d-128f-4392-a76c-783d2d1f3cef+14:2396:x1875463170549248:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581509.495677:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.495687:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581509.495695:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 14 pid: 17056 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.495708:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 14 pid: 17056 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.495728:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581509.495736:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581509.495743:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+4:20091:x1875463184257024:12345-0@lo:104: Request processed in 973us (3851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581509.495749:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581509.495775:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcfe639d-128f-4392-a76c-783d2d1f3cef+14:2396:x1875463170549248:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581509.495777:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581509.495791:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1788581509.495792:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:20091:x1875463184257408:12345-0@lo:104: 00010000:00010000:1.0:1788581509.495802:0:17046:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581509.495814:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:2.0:1788581509.495829:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170549376:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581509.495836:0:17046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788581509.495839:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788581509.495845:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+3:20091:x1875463184257408:12345-0@lo:104: Request processed in 57us (1628us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581509.495849:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 13 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581509.495857:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788581509.495867:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 13 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.495878:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581509.495897:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170549376:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (379us total) trans 0 rc 0/0 00010000:00010000:1.0:1788581509.495899:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788581509.495907:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00010000:00010000:2.0:1788581509.495995:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581509.496001:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.496008:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581509.496012:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.496021:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581509.496028:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581509.496034:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581509.496077:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.496085:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581509.496104:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.496111:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa71600/0x50f0cc74b7b30e8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30e95 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.496123:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581509.496125:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581509.496127:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581509.496141:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581509.496153:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184257536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581509.496187:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581509.496709:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44800/0x50f0cc74b7b311cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2244e expref: 12 pid: 17056 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.496722:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256512:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581509.496733:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980000/0x50f0cc74b7b31190 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df223de expref: 11 pid: 17057 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.496741:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184256640:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581509.496751:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184257024:0@lo:104: 00000100:00100000:3.0:1788581509.496758:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875463184257408:0@lo:104: 00010000:00010000:3.0:1788581509.496793:0:20091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.496825:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257536 00000100:00100000:3.0:1788581509.496830:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257536 00010000:00010000:3.0:1788581509.496850:0:20093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 22 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581509.496885:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581509.496892:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3619:x1875463184257536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581509.496900:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581509.496998:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497006:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581509.497010:0:17051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497029:0:17051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581509.497149:0:17051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581509.497157:0:17051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581509.497182:0:17051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497188:0:17051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581509.497201:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497208:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa71a00/0x50f0cc74b7b30e9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b30ea3 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497222:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581509.497224:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581509.497225:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581509.497390:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581509.497402:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184257664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581509.497444:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581509.497608:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257664 00000100:00100000:1.0:1788581509.497613:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257664 00010000:00010000:1.0:1788581509.497630:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581509.497662:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581509.497669:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:3618:x1875463184257664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581509.497693:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581509.497698:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497714:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497728:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4000/0x50f0cc74b7b30ea3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e9c expref: 23 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581509.497739:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581509.497843:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3618:x1875463184257664:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581509.497851:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788581509.497931:0:20093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 21 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497940:0:20093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 21 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497950:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5a00/0x50f0cc74b7b30e95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b30e8e expref: 21 pid: 17058 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497962:0:20093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497970:0:20093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497984:0:20093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.497990:0:20093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498008:0:20093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498014:0:20093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498018:0:20093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581509.498022:0:20093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498029:0:20093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498064:0:20093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581509.498074:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581509.498112:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+20:3619:x1875463184257536:12345-0@lo:103:ldlm_bl.0 Request processed in 1221us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581509.498119:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788581509.498249:0:20091:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.498284:0:20091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581509.498290:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f981000/0x50f0cc74b7b31200 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581509.499202:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184257536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581509.505019:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184257664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581509.697625:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581510.722923:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581510.766166:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581510.766307:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549504 00000100:00100000:1.0:1788581510.766317:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549504 00000100:00100000:1.0:1788581510.766382:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:1.0:1788581510.766400:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:14887:x1875463170549504:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581510.766418:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581510.766445:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b31207 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22486 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.766492:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b31207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22486 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.766505:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b31207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22486 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.766521:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44400, rc 0) 00000100:00100000:1.0:1788581510.766611:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e82051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549504:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 214us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.766619:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:1.0:1788581510.781842:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581510.784740:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549632 00000100:00100000:3.0:1788581510.784760:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549632 00000100:00100000:3.0:1788581510.784832:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:3.0:1788581510.784844:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549632:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.785046:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549632:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 203us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.785063:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:3.0:1788581510.800411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581510.800950:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549760 00000100:00100000:1.0:1788581510.800960:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549760 00000100:00100000:1.0:1788581510.801021:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:1.0:1788581510.801045:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549760:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.801208:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549760:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 176us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.801216:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1788581510.840449:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581510.842541:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170549888 00000100:00100000:3.0:1788581510.842556:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170549888 00000100:00100000:3.0:1788581510.842629:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:3.0:1788581510.842640:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:14887:x1875463170549888:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581510.842656:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581510.842673:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f980e00/0x50f0cc74b7b3120e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df2248d expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.842702:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980e00/0x50f0cc74b7b3120e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2248d expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.842713:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f980e00/0x50f0cc74b7b3120e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2248d expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.842723:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980e00, rc 0) 00000100:00100000:3.0:1788581510.842786:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:14887:x1875463170549888:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 149us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.842793:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1788581510.859069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581510.859149:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550016 00000100:00100000:3.0:1788581510.859158:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550016 00000100:00100000:3.0:1788581510.859212:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:3.0:1788581510.859221:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:14887:x1875463170550016:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.859381:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:14887:x1875463170550016:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 159us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.859389:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:3.0:1788581510.863298:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581510.863748:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550144 00000100:00100000:1.0:1788581510.863758:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550144 00000100:00100000:1.0:1788581510.863819:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1788581510.863830:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:14887:x1875463170550144:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.863971:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:14887:x1875463170550144:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 142us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.863980:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 10000000:01000000:0.0:1788581510.917998:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581510.918006:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e50dc7800 from 13 10000000:01000000:0.0:1788581510.918012:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581510.918086:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.918098:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.918110:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581510.918151:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184257792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581510.918221:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581510.918285:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6be0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581510.918386:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257792 00000100:00100000:1.0:1788581510.918394:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257792 00000100:00100000:1.0:1788581510.918445:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788581510.918455:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+20:17060:x1875463184257792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581510.918484:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581510.918497:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b3121c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31215 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.918532:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b3121c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31215 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.918541:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b3121c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31215 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.918551:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44200, rc 0) 00000100:00100000:1.0:1788581510.918592:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184257792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.918599:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788581510.919689:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184257792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581510.919709:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.919720:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581510.919789:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184257920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581510.919831:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581510.919865:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6be0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581510.920311:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184257920 00000100:00100000:1.0:1788581510.920318:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184257920 00000100:00100000:1.0:1788581510.920354:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788581510.920364:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184257920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.921157:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184257920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 792us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.921167:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788581510.921296:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184257920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581510.921335:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581510.921383:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581510.921411:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6be0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581510.923149:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258048 00000100:00100000:1.0:1788581510.923160:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258048 00000100:00100000:1.0:1788581510.923279:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788581510.923289:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184258048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.923427:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184258048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.923435:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788581510.927601:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788581510.928298:0:20144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788581510.928354:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788581510.928371:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581510.928381:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.928407:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581510.928418:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581510.928420:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7fa35800 from 13 10000000:01000000:0.0:1788581510.928422:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581510.928454:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.928462:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581510.928471:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581510.928491:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581510.928549:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581510.941973:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6be0cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581510.957059:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258176 00000100:00100000:3.0:1788581510.957076:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258176 00000100:00100000:1.0:1788581510.960836:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788581510.960850:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:17060:x1875463184258176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581510.960877:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581510.960895:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b3122a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31223 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.960923:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b3122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31223 expref: 22 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.960934:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b3122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31223 expref: 22 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.960944:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44600, rc 0) 00000100:00100000:1.0:1788581510.961032:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (32483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.961039:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788581510.963061:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581510.963088:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.963102:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581510.963190:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.963247:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581510.963317:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581510.963998:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258304 00000100:00100000:3.0:1788581510.964006:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258304 00000100:00100000:3.0:1788581510.964065:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788581510.964076:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.964201:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.964209:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788581510.964273:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.964323:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.964370:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581510.964386:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581510.964398:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258432 00000100:00100000:3.0:1788581510.964402:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258432 00000100:00100000:3.0:1788581510.964419:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788581510.964425:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.964637:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.964644:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788581510.964686:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788581510.975679:0:20146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788581510.976038:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788581510.976077:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581510.976089:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.976135:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581510.976145:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581510.976148:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7a4de800 from 13 10000000:01000000:3.0:1788581510.976151:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581510.976197:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.976205:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.976222:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581510.976281:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.976351:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581510.976390:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581510.978838:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258560 00000100:00100000:2.0:1788581510.978853:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258560 00000100:00100000:2.0:1788581510.978921:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788581510.978932:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:17060:x1875463184258560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581510.978953:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581510.978971:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31238 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31231 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581510.978999:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31231 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581510.979009:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31231 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581510.979018:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ea00, rc 0) 00000100:00100000:2.0:1788581510.979105:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581510.979112:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788581510.979238:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581510.979282:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.979292:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581510.979366:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.979403:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581510.979450:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581510.979544:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258688 00000100:00100000:1.0:1788581510.979549:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258688 00000100:00100000:1.0:1788581510.979577:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581510.979584:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.979707:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.979715:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788581510.979962:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.979992:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581510.980031:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581510.980066:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581510.980109:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258816 00000100:00100000:1.0:1788581510.980113:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258816 00000100:00100000:1.0:1788581510.980148:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581510.980156:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.980234:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581510.980241:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788581510.980350:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581510.981280:0:20147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788581510.981499:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788581510.981521:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581510.981531:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.981542:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581510.981552:0:17060:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581510.981554:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e4eb3d800 from 13 10000000:01000000:1.0:1788581510.981557:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581510.981587:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.981594:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.981603:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581510.981634:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.981676:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581510.981713:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581510.982187:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184258944 00000100:00100000:3.0:1788581510.982195:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184258944 00000100:00100000:3.0:1788581510.982239:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788581510.982248:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+23:17060:x1875463184258944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581510.982297:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581510.982311:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e6f980400/0x50f0cc74b7b31246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3123f expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.982333:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e6f980400/0x50f0cc74b7b31246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3123f expref: 24 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.982343:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e6f980400/0x50f0cc74b7b31246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3123f expref: 24 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581510.982351:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980400, rc 0) 00000100:00100000:3.0:1788581510.982392:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184258944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581510.982397:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581510.984880:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184258944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581510.984911:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581510.984925:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581510.985011:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184259072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.985080:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581510.985121:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581510.986644:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259072 00000100:00100000:2.0:1788581510.986656:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259072 00000100:00100000:2.0:1788581510.986713:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788581510.986723:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184259072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581510.986878:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184259072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581510.986885:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788581510.987159:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184259072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.987217:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184259200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581510.987279:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581510.987310:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f2529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581510.987626:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259200 00000100:00100000:2.0:1788581510.987632:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259200 00000100:00100000:2.0:1788581510.987669:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788581510.987677:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184259200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581510.987772:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:17060:x1875463184259200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581510.987780:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581510.988690:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:611141c5-6f74-41ea-b38f-6fb1248f7899:17060:1875463184259200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581510.989921:0:20148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788581510.999661:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788581510.999702:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581510.999715:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581510.999728:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581511.747611:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581512.515559:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581512.515581:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184259328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581512.515647:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581512.515816:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259328 00000100:00100000:0.0:1788581512.515827:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259328 00000100:00100000:0.0:1788581512.515889:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581512.515898:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184259328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581512.515926:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581512.515971:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184259328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581512.515978:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581512.516035:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184259328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788581512.516420:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581512.769413:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581512.939705:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.939764:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.939801:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.939954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.939974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581512.939979:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550272 00000100:00100000:2.0:1788581512.939991:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550272 00000100:00100000:2.0:1788581512.940049:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:2.0:1788581512.940059:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170550272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581512.940125:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170550272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 67us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581512.940132:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:0.0:1788581512.940374:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550528 00000100:00100000:0.0:1788581512.940379:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550528 00000100:00100000:0.0:1788581512.940429:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551040 00000100:00100000:0.0:1788581512.940432:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551040 00000100:00100000:0.0:1788581512.940452:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1788581512.940458:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581512.940495:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 37us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581512.940502:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1788581512.940517:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1788581512.940523:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581512.940545:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581512.940551:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00080000:2.0:1788581512.940794:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581512.944074:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581512.944112:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.945554:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550400 00000100:00100000:3.0:1788581512.945568:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550400 00000100:00100000:3.0:1788581512.945639:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1788581512.945651:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2396:x1875463170550400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581512.945729:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2396:x1875463170550400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581512.945737:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00080000:3.0:1788581512.946000:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581512.950694:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550784 00000100:00100000:1.0:1788581512.950710:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550784 00000100:00100000:1.0:1788581512.950790:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551296 00000100:00100000:1.0:1788581512.950794:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551296 00000100:00100000:1.0:1788581512.950828:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1788581512.950838:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581512.950917:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 80us (11114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581512.950925:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1788581512.950947:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581512.950953:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581512.950978:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (11003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581512.950984:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00080000:3.0:1788581512.951101:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581512.959938:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581512.959984:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581512.960204:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550656 00000100:00100000:3.0:1788581512.960215:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550656 00000100:00100000:3.0:1788581512.960299:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551168 00000100:00100000:3.0:1788581512.960303:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551168 00000100:00100000:3.0:1788581512.960324:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581512.960334:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581512.960411:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170550656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (16288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581512.960419:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581512.960435:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581512.960442:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551168:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581512.960467:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2396:x1875463170551168:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581512.960473:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1788581512.963362:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170550912 00000100:00100000:1.0:1788581512.963377:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170550912 00000100:00080000:2.0:1788581512.963524:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581512.963529:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581512.963565:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1788581512.963576:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170550912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581512.963671:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170550912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 97us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581512.963679:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1788581513.025851:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184259456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581513.025938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581513.028798:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259456 00000100:00100000:2.0:1788581513.028811:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259456 00000100:00100000:2.0:1788581513.028887:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581513.028897:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184259456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581513.028932:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788581513.029011:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184259456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581513.029018:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788581513.029702:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581513.029717:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581513.029761:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581513.030986:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259584 00000100:00100000:0.0:1788581513.030996:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259584 00000100:00100000:0.0:1788581513.031074:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581513.031084:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184259584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581513.031115:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788581513.031183:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184259584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581513.031189:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581513.031241:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184259456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581513.031570:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581513.537738:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581513.537775:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184259712:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.537845:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.537973:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184259840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581513.538016:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581513.542118:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259712 00000100:00100000:0.0:1788581513.542129:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259712 00000100:00100000:0.0:1788581513.542193:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788581513.542203:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184259712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581513.542290:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184259712:12345-0@lo:400:kworker.0 Request processed in 89us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581513.542297:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788581513.542339:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184259968:0@lo:400:kworker.0 00000100:00100000:0.0:1788581513.542382:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.542749:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184259712:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.542778:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259968 00000100:00100000:1.0:1788581513.542782:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259968 00000100:00100000:1.0:1788581513.542827:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581513.542835:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184259968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.542875:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184259968:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.542880:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581513.542923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184260096:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.542950:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.543004:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581513.543011:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184260224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.543070:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260224 00000100:00100000:1.0:1788581513.543074:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260224 00000100:00100000:1.0:1788581513.543102:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581513.543108:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184260224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543141:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184260224:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.543146:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581513.543188:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184260224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.543314:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260608 00000100:00100000:1.0:1788581513.543318:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260608 00000100:00100000:1.0:1788581513.543337:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581513.543342:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184260608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543381:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184260608:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.543387:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581513.543411:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543438:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581513.543445:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184260736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543467:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.543487:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260736 00000100:00100000:1.0:1788581513.543491:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260736 00000100:00100000:1.0:1788581513.543511:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788581513.543529:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184260736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543561:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184260736:12345-0@lo:400:kworker.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.543567:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788581513.543592:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184260736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543626:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543644:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.543661:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184261120 00000100:00100000:1.0:1788581513.543664:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184261120 00000100:00100000:1.0:1788581513.543681:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581513.543686:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184261120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543710:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184261120:12345-0@lo:400:kworker.0 Request processed in 24us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.543721:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788581513.543744:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4384d500 x1875463184261120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581513.543754:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543816:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581513.543822:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184261248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581513.543858:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260096 00000100:00100000:1.0:1788581513.543861:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260096 00000100:00100000:1.0:1788581513.543880:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581513.543886:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.543912:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184260096:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.543916:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788581513.544247:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581513.544278:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581513.544281:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581513.544283:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581513.558837:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184260352:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.558899:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.558930:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.558954:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.558972:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184261376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581513.559003:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.559024:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788581513.559040:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.559062:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.559079:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184260992:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.559099:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581513.559139:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184259840 00000100:00100000:2.0:1788581513.559141:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260352 00000100:00100000:3.0:1788581513.559146:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184259840 00000100:00100000:2.0:1788581513.559146:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260352 00000100:00100000:3.0:1788581513.559190:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184261376 00000100:00100000:3.0:1788581513.559193:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184261376 00000100:00100000:3.0:1788581513.559221:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581513.559229:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184259840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581513.559250:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581513.559311:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184259840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (21293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.559318:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581513.559332:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581513.559338:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184261376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581513.559354:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788581513.559407:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184261376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.559413:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581513.559474:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581513.559514:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184260096:0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.559562:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184261248 00000100:00100000:1.0:1788581513.559566:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184261248 00000100:00100000:1.0:1788581513.559585:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581513.559591:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184261248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581513.559600:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788581513.559631:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184261248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.559637:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581513.559671:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184261248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581513.559700:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260864 00000100:00100000:1.0:1788581513.559710:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260864 00000100:00100000:1.0:1788581513.559736:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260992 00000100:00100000:1.0:1788581513.559739:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260992 00000100:00100000:1.0:1788581513.559759:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581513.559765:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184260864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.559797:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184260864:12345-0@lo:400:kworker.0 Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.559803:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581513.559816:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788581513.559821:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184260992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581513.559844:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184260992:12345-0@lo:400:kworker.0 Request processed in 24us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.559850:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581513.560129:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184260480 00000100:00100000:2.0:1788581513.560133:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184260480 00000100:00100000:3.0:1788581513.560502:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581513.560523:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184260352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.560565:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184260352:12345-0@lo:400:kworker.0 Request processed in 56us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.560571:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581513.560586:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581513.560591:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184260480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.560615:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184260480:12345-0@lo:400:kworker.0 Request processed in 25us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.560622:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581513.560652:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.560660:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184260992:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.560668:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184260352:0@lo:400:kworker.0 00010000:00080000:3.0:1788581513.560680:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4384e680 x1875463184260864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581513.560690:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788581513.560702:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184261376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581513.560716:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184259840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581513.560754:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581513.560759:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581513.560770:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581513.561045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184259968:0@lo:400:kworker.0 00010000:00010000:3.0:1788581513.794991:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581513.795861:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788581513.796552:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581513.796587:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551424 00000100:00100000:3.0:1788581513.796596:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551424 00000100:00100000:3.0:1788581513.796645:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1788581513.796655:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:15551:x1875463170551424:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581513.796674:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581513.796694:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3124d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22494 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796758:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796771:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796783:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796795:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796801:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796806:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796885:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796910:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.796917:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581513.796946:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581513.796950:0:17063:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581513.796990:0:17063:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797000:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797005:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797012:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797017:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581513.797021:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797039:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797053:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:3.0:1788581513.797057:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581513.797062:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797080:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797095:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797100:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797106:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797111:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581513.797114:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797120:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797128:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff995e6f929400) 00010000:00010000:3.0:1788581513.797131:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581513.797134:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797139:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3125b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797170:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b3124d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22494 expref: 8 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797182:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22494 expref: 7 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581513.797195:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995e6f929b00) 00010000:00010000:3.0:1788581513.797197:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581513.797200:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581513.797294:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+7:15551:x1875463170551424:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 600us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.797301:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1788581513.806380:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581513.806704:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551552 00000100:00100000:1.0:1788581513.806713:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551552 00000100:00100000:1.0:1788581513.806820:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1788581513.806832:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e62527f4-3622-4ebf-800d-388b643273eb+7:15551:x1875463170551552:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788581513.806916:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e62527f4-3622-4ebf-800d-388b643273eb+7:15551:x1875463170551552:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 88us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581513.806924:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581513.809859:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581513.810677:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551808 00000100:00100000:0.0:1788581513.810687:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551808 00000100:00100000:0.0:1788581513.810750:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581513.810761:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+7:15551:x1875463170551808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581513.810780:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581513.810800:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b31269 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2249b expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.810881:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.810894:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.810907:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811098:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811106:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811113:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811216:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3127e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811224:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3127e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811231:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3127e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581513.811240:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788581513.811919:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811930:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811937:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811942:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581513.811946:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811964:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811979:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995e6f929b00) 00010000:00010000:0.0:1788581513.811982:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581513.811986:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.811992:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31270 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812004:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812010:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812016:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812020:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581513.812023:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812042:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812049:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff995e6625ed00) 00010000:00010000:0.0:1788581513.812051:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581513.812055:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.812070:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31277 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.813338:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b31269 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2249b expref: 10 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.813357:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3127e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2249b expref: 9 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.813365:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6625e300) 00010000:00010000:0.0:1788581513.813368:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581513.813370:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71a00, rc 0) 00000100:00100000:0.0:1788581513.813627:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+9:15551:x1875463170551808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2866us (3775us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788581513.813636:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581513.824152:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581513.824368:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170551936 00000100:00100000:3.0:1788581513.824378:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170551936 00000100:00100000:3.0:1788581513.826211:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581513.826230:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+9:15551:x1875463170551936:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788581513.826363:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+9:15551:x1875463170551936:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 141us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.826370:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1788581513.829844:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581513.829931:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552064 00000100:00100000:2.0:1788581513.829941:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552064 00000100:00100000:2.0:1788581513.829999:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581513.830008:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:15551:x1875463170552064:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788581513.838687:0:17065:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8626us 00000100:00100000:0.0:1788581513.866977:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:15551:x1875463170552064:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 36956us (37129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581513.866993:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1788581513.923330:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581513.923478:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552192 00000100:00100000:1.0:1788581513.923488:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552192 00000100:00100000:1.0:1788581513.923547:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581513.923558:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+9:15557:x1875463170552192:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581513.923596:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581513.923625:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44800/0x50f0cc74b7b3128c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224a2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923707:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923721:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923735:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923751:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923759:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923766:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923818:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923825:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923832:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923838:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccac00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581513.923848:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923857:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923870:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:1.0:1788581513.923873:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581513.923877:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923883:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b31293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923897:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923903:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923908:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923913:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581513.923916:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923922:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923929:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995e47fbc100) 00010000:00010000:1.0:1788581513.923931:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581513.923939:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923945:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b3129a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923976:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44800/0x50f0cc74b7b3128c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224a2 expref: 10 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.923987:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:1.0:1788581513.923989:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581513.923993:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44800/0x50f0cc74b7b3128c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224a2 expref: 10 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.924001:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fb44800, rc 0) 00000100:00100000:1.0:1788581513.924075:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+9:15557:x1875463170552192:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 519us (754us total) trans 0 rc 301/301 00000100:00100000:1.0:1788581513.924082:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581513.941608:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581513.941725:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552320 00000100:00100000:3.0:1788581513.941734:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552320 00000100:00100000:3.0:1788581513.941781:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1788581513.941791:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e62527f4-3622-4ebf-800d-388b643273eb+9:15557:x1875463170552320:12345-192.168.203.3@tcp:700:lfs.0 00000100:00100000:3.0:1788581513.941873:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e62527f4-3622-4ebf-800d-388b643273eb+9:15557:x1875463170552320:12345-192.168.203.3@tcp:700:lfs.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581513.941881:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581513.951905:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581513.951963:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552576 00000100:00100000:0.0:1788581513.951973:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552576 00000100:00100000:0.0:1788581513.952046:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1788581513.952057:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+9:15557:x1875463170552576:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:0.0:1788581513.952108:0:20048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581513.952137:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fb44a00/0x50f0cc74b7b311ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2240f expref: 9 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.952175:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:0.0:1788581513.952181:0:20048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581513.952700:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.952716:0:20048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 5 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.952726:0:20048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.952805:0:20048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 5 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581513.952820:0:20048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 5 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581513.952835:0:20048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20048:1875463184261504:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581513.952913:0:20048:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581513.955685:0:20048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20048:1875463184261504:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581513.955714:0:20048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581513.957582:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581513.957682:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552704 00000100:00100000:0.0:1788581513.957693:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552704 00010000:00010000:0.0:1788581513.957733:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 6 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581513.957774:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1788581513.957784:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2395:x1875463170552704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581513.957797:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581513.957803:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 6 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957818:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 6 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957838:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b311f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2247f expref: 6 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957870:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:0.0:1788581513.957875:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957884:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957891:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581513.957938:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581513.957947:0:20048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.957954:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.957976:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.957986:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581513.957992:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2395:x1875463170552704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 209us (419us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581513.957995:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581513.957999:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00010000:00010000:2.0:1788581513.961955:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.961974:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.961983:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581513.961997:0:20048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a22ec15 reply state 000000001dbda045 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962008:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962016:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:2.0:1788581513.962025:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581513.962038:0:20048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788581513.962044:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581513.962054:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962061:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962069:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962075:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581513.962083:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962091:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962103:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47fbc700) 00010000:00010000:2.0:1788581513.962105:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581513.962109:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962114:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581513.962133:0:20048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a22ec15 reply state 000000001dbda045 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962141:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581513.962158:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995d42038500) 00010000:00010000:2.0:1788581513.962160:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581513.962162:0:20048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788581513.962290:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+10:15557:x1875463170552576:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 10231us (10391us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788581513.962299:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1788581514.105830:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.105922:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552832 00000100:00100000:0.0:1788581514.105932:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552832 00000100:00080000:3.0:1788581514.106086:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581514.106196:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:0.0:1788581514.106208:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+10:15565:x1875463170552832:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:0.0:1788581514.106233:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581514.106347:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b312b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224a9 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106579:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106594:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106604:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581514.106658:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581514.106662:0:17064:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581514.106699:0:17064:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106723:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b312b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224a9 expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106740:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224a9 expref: 11 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.106749:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:0.0:1788581514.106751:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581514.106755:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70c00, rc 0) 00000100:00100000:0.0:1788581514.106865:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+11:15565:x1875463170552832:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 660us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581514.106871:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1788581514.153121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.153787:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170552960 00000100:00100000:1.0:1788581514.153798:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170552960 00000100:00100000:1.0:1788581514.153921:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1788581514.153931:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:15566:x1875463170552960:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581514.153950:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.153970:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b312c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224b0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154040:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154053:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154074:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581514.154121:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581514.154125:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581514.154147:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154169:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b312c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b0 expref: 7 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154188:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b0 expref: 6 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.154196:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:1.0:1788581514.154210:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581514.154214:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccac00, rc 0) 00000100:00100000:1.0:1788581514.154325:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15566:x1875463170552960:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 395us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.154332:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00080000:3.0:1788581514.158938:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581514.159129:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.160681:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170553088 00000100:00100000:0.0:1788581514.160695:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170553088 00000100:00100000:0.0:1788581514.160764:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1788581514.160774:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:15566:x1875463170553088:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581514.160796:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581514.160815:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b312d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224b7 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160881:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160914:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160925:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160939:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160947:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.160953:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161038:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161047:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161211:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581514.161815:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581514.161820:0:17064:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581514.161845:0:17064:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161860:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161878:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161884:0:17064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161890:0:17064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581514.161894:0:17064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161901:0:17064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161914:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:0.0:1788581514.161916:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581514.161920:0:17064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161926:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b312d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161939:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161944:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161950:0:17064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161954:0:17064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581514.161962:0:17064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161968:0:17064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161975:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995d42038500) 00010000:00010000:0.0:1788581514.161978:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581514.161981:0:17064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.161985:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b312e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.162014:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b312d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b7 expref: 8 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.162037:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b7 expref: 7 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.162045:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:0.0:1788581514.162047:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581514.162050:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71800, rc 0) 00000100:00100000:0.0:1788581514.162241:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+7:15566:x1875463170553088:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1467us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581514.162249:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1788581514.167628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581514.167729:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170553216 00000100:00100000:3.0:1788581514.167752:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170553216 00000100:00100000:3.0:1788581514.167861:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581514.167872:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:15566:x1875463170553216:12345-192.168.203.3@tcp:900:lfs.0 00000100:00100000:3.0:1788581514.167960:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:15566:x1875463170553216:12345-192.168.203.3@tcp:900:lfs.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581514.167968:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00080000:2.0:1788581514.169117:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581514.171639:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.171739:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170553472 00000100:00100000:1.0:1788581514.171749:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170553472 00000100:00100000:1.0:1788581514.171837:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1788581514.171848:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+7:15566:x1875463170553472:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581514.171868:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.171888:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b312ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224be expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581514.171987:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788581514.172096:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b312ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224be expref: 9 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.172111:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:1.0:1788581514.172114:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581514.172120:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b312ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224be expref: 9 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.172133:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca200, rc 0) 00000100:00100000:1.0:1788581514.172196:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+8:15566:x1875463170553472:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 350us (565us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788581514.172203:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1788581514.176703:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.176783:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170553728 00000100:00100000:1.0:1788581514.176806:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170553728 00000100:00100000:1.0:1788581514.176863:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1788581514.176874:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+8:15566:x1875463170553728:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:1.0:1788581514.176924:0:17063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581514.176950:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71800/0x50f0cc74b7b312e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b7 expref: 8 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.176969:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581514.176974:0:17063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581514.176994:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.177006:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.177014:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581514.177231:0:17063:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004ab1e52 reply state 00000000426ed6d2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.177244:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.177250:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581514.177414:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788581514.177418:0:17063:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788581514.177427:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788581514.177928:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+9:15566:x1875463170553728:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 1053us (1230us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788581514.177935:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1788581514.180563:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.181926:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170553984 00000100:00100000:1.0:1788581514.181940:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170553984 00000100:00100000:1.0:1788581514.181997:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1788581514.182008:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+9:15566:x1875463170553984:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1788581514.182241:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+10:15566:x1875463170553984:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 233us (1685us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788581514.182249:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000040:00080000:2.0:1788581514.182798:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581514.188160:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.188238:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170554240 00000100:00100000:1.0:1788581514.188247:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170554240 00000100:00100000:1.0:1788581514.188681:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1788581514.188692:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+10:15566:x1875463170554240:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581514.188716:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.188736:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224c5 expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188808:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188822:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188833:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188843:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188851:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.188877:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581514.188985:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788581514.189066:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189074:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189083:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189088:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccba00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581514.189093:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189099:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189111:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:1.0:1788581514.189114:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581514.189118:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189124:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3130a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189137:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189153:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189159:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189163:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccbc00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581514.189167:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189172:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189181:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995d42038500) 00010000:00010000:1.0:1788581514.189184:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581514.189187:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189192:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccbc00/0x50f0cc74b7b31311 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189225:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31303 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224c5 expref: 12 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189235:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:1.0:1788581514.189236:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581514.189241:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224c5 expref: 12 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.189695:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca200, rc 0) 00000100:00100000:1.0:1788581514.189770:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+11:15566:x1875463170554240:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1079us (1617us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788581514.189778:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1788581514.193354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.193924:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170554368 00000100:00100000:1.0:1788581514.193935:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170554368 00000100:00100000:1.0:1788581514.193994:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581514.194010:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+11:15566:x1875463170554368:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581514.194043:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.194064:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca600/0x50f0cc74b7b3131f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224cc expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194155:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194169:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194180:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581514.194203:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581514.194207:0:17063:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581514.194226:0:17063:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194251:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca600/0x50f0cc74b7b3131f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 13 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194325:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 12 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.194333:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581514.194336:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581514.194339:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb000, rc 0) 00000100:00100000:1.0:1788581514.194802:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+12:15566:x1875463170554368:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 790us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.194810:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1788581514.201192:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.201553:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170554496 00000100:00100000:1.0:1788581514.201564:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170554496 00000100:00100000:1.0:1788581514.201624:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1788581514.201635:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+12:15566:x1875463170554496:12345-192.168.203.3@tcp:37:lfs.0 00000100:00100000:1.0:1788581514.210788:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+12:15566:x1875463170554496:12345-192.168.203.3@tcp:37:lfs.0 Request processed in 9145us (9596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.210800:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1788581514.215883:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581514.215970:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170554752 00000100:00100000:3.0:1788581514.215979:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170554752 00000100:00100000:3.0:1788581514.216043:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581514.216053:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+12:15566:x1875463170554752:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581514.216325:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+13:15566:x1875463170554752:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 272us (451us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788581514.216332:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581514.278724:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.279394:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170554880 00000100:00100000:0.0:1788581514.279405:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170554880 00000100:00100000:0.0:1788581514.279475:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1788581514.279486:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+11:15572:x1875463170554880:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581514.279521:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581514.279542:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272600/0x50f0cc74b7b3132d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224d3 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279607:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279621:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279632:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279643:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279650:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279656:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279729:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279738:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279744:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581514.279774:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581514.279783:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581514.279834:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279848:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279853:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279859:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279864:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581514.279868:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279874:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279885:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:0.0:1788581514.279888:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581514.279892:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279897:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273000/0x50f0cc74b7b31334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279908:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279913:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279927:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279932:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581514.279935:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279940:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279947:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995d42038500) 00010000:00010000:0.0:1788581514.279949:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581514.279952:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279956:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272e00/0x50f0cc74b7b3133b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279982:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272600/0x50f0cc74b7b3132d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224d3 expref: 13 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.279995:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224d3 expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.280002:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:0.0:1788581514.280004:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788581514.280006:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273600, rc 0) 00000100:00100000:0.0:1788581514.280081:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:15572:x1875463170554880:12345-192.168.203.3@tcp:101:bash.0 Request processed in 596us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581514.280097:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1788581514.284724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581514.285187:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170555008 00000100:00100000:3.0:1788581514.285198:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170555008 00000100:00100000:1.0:1788581514.285722:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581514.285737:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e62527f4-3622-4ebf-800d-388b643273eb+5:15572:x1875463170555008:12345-192.168.203.3@tcp:900:bash.0 00000100:00100000:1.0:1788581514.285821:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e62527f4-3622-4ebf-800d-388b643273eb+5:15572:x1875463170555008:12345-192.168.203.3@tcp:900:bash.0 Request processed in 89us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.285829:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00080000:2.0:1788581514.285921:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581514.289877:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.289973:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170555264 00000100:00100000:1.0:1788581514.289983:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170555264 00000100:00100000:1.0:1788581514.290047:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:1.0:1788581514.290071:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+12:15572:x1875463170555264:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581514.290091:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.290110:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca600/0x50f0cc74b7b31349 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224da expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.290205:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.290221:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 12 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.290229:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.290302:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 12 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.290317:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 12 pid: 17063 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581514.290330:0:17063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17063:1875463184261632:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581514.290754:0:17063:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581514.295148:0:17063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17063:1875463184261632:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581514.295177:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581514.297149:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.297711:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170555392 00000100:00100000:1.0:1788581514.297722:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170555392 00010000:00010000:1.0:1788581514.297770:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 13 pid: 17063 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581514.297806:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1788581514.297815:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+13:2396:x1875463170555392:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581514.297828:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581514.297835:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 13 pid: 17063 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297848:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 13 pid: 17063 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297869:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b31326 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224cc expref: 13 pid: 17063 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297886:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581514.297891:0:17049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297902:0:17049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297910:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.297946:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581514.298003:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+12:2396:x1875463170555392:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 188us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.298010:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00010000:00010000:2.0:1788581514.298162:0:17063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.298170:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.298192:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.298211:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.298218:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299012:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299052:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299062:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581514.299073:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581514.299099:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299117:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299124:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299129:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581514.299133:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299140:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299162:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:2.0:1788581514.299165:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581514.299169:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299175:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca200/0x50f0cc74b7b31350 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581514.299188:0:17063:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e612742 reply state 00000000808a463d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299199:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.299205:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff995d42038b00) 00010000:00010000:2.0:1788581514.299207:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581514.299210:0:17063:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788581514.299243:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca600/0x50f0cc74b7b31349 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 15 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.300057:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 14 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.300067:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581514.300070:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788581514.300072:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e000, rc 0) 00000100:00100000:2.0:1788581514.300127:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+15:15572:x1875463170555264:12345-192.168.203.3@tcp:101:bash.0 Request processed in 10058us (10258us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788581514.300135:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:0.0:1788581514.317193:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581514.317303:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170555520 00000100:00100000:1.0:1788581514.317313:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170555520 00000100:00100000:1.0:1788581514.317371:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:1.0:1788581514.317381:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+15:15572:x1875463170555520:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581514.317413:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581514.317434:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b3136c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224e1 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317515:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317528:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317541:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581514.317588:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788581514.317593:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581514.317612:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317623:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317648:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b3136c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224e1 expref: 17 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317665:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224e1 expref: 16 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581514.317695:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581514.317697:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581514.317701:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccba00, rc 0) 00000100:00100000:1.0:1788581514.317955:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+16:15572:x1875463170555520:12345-192.168.203.3@tcp:101:bash.0 Request processed in 573us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581514.317962:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1788581514.323880:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581514.323945:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170555776 00000100:00100000:3.0:1788581514.323955:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170555776 00000100:00100000:3.0:1788581514.324012:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581514.324023:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+16:15572:x1875463170555776:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1788581514.324801:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+17:15572:x1875463170555776:12345-192.168.203.3@tcp:35:bash.0 Request processed in 775us (926us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788581514.324810:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1788581514.440238:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581514.440965:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170556032 00000100:00100000:3.0:1788581514.440991:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170556032 00000100:00100000:3.0:1788581514.441112:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1788581514.441123:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+17:15582:x1875463170556032:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581514.441149:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581514.441169:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3137a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224e8 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581514.441340:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788581514.441469:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3137a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224e8 expref: 19 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581514.441483:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:3.0:1788581514.441486:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581514.441490:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b3137a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224e8 expref: 19 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581514.441503:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:3.0:1788581514.441560:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+18:15582:x1875463170556032:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 438us (1344us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788581514.441567:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1788581514.445775:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.445936:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170556288 00000100:00100000:0.0:1788581514.445947:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170556288 00000100:00100000:0.0:1788581514.446000:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1788581514.446011:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+18:15582:x1875463170556288:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581514.446234:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+19:15582:x1875463170556288:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 224us (534us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788581514.446242:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1788581514.513848:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581514.514105:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170556544 00000100:00100000:2.0:1788581514.514116:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170556544 00000100:00100000:2.0:1788581514.514181:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1788581514.514192:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+19:15585:x1875463170556544:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581514.514216:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581514.514236:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31388 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224ef expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.514395:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b3138f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.514422:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b3138f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.514435:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b3138f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581514.514724:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581514.514841:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31388 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224ef expref: 22 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.514862:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b3138f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224ef expref: 21 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.514870:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581514.514873:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581514.514877:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581514.514950:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+21:15585:x1875463170556544:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 759us (1111us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788581514.514970:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1788581514.521040:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.521114:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170556672 00000100:00100000:0.0:1788581514.521124:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170556672 00000100:00100000:0.0:1788581514.521187:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581514.521198:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+21:2395:x1875463170556672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581514.521212:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581514.521236:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b3138f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224ef expref: 21 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581514.521299:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581514.521304:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581514.521356:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+20:2395:x1875463170556672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581514.521363:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1788581514.524888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581514.524970:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170556800 00000100:00100000:2.0:1788581514.524979:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170556800 00000100:00100000:2.0:1788581514.525042:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1788581514.525051:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+20:15585:x1875463170556800:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1788581514.525114:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525129:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525140:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525187:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525194:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525201:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525208:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581514.525212:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525218:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525250:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581514.525299:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581514.525304:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.525310:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b3139d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581514.525384:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+20:15585:x1875463170556800:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 333us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581514.525391:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1788581514.536227:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.536382:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170557056 00000100:00100000:0.0:1788581514.536391:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170557056 00000100:00100000:0.0:1788581514.536453:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581514.536479:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+20:15585:x1875463170557056:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581514.536937:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+21:15585:x1875463170557056:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 457us (723us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788581514.536946:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00010000:00010000:1.0:1788581514.817433:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581514.818146:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788581514.964404:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581514.964569:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170557312 00000100:00100000:2.0:1788581514.964580:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170557312 00000100:00100000:2.0:1788581514.964645:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1788581514.964656:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+21:15616:x1875463170557312:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1788581514.964680:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581514.964708:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224f6 expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.964824:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.964838:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.964850:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581514.964881:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581514.965003:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224f6 expref: 24 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.965037:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224f6 expref: 23 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.965045:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581514.965047:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581514.965051:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00000100:00100000:2.0:1788581514.965204:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+23:15616:x1875463170557312:12345-192.168.203.3@tcp:101:cat.0 Request processed in 548us (808us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788581514.965211:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:1.0:1788581514.976685:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581514.976809:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170557440 00000100:00100000:2.0:1788581514.976826:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170557440 00000100:00100000:2.0:1788581514.976908:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1788581514.976926:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e62527f4-3622-4ebf-800d-388b643273eb+23:2394:x1875463170557440:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581514.976942:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581514.976973:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224f6 expref: 23 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581514.977002:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581514.977007:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581514.977086:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e62527f4-3622-4ebf-800d-388b643273eb+22:2394:x1875463170557440:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 169us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581514.977094:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1788581514.982177:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581514.982297:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170557696 00000100:00100000:0.0:1788581514.982306:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170557696 00000100:00100000:0.0:1788581514.982361:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1788581514.982371:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+22:15616:x1875463170557696:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:0.0:1788581514.982661:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+23:15616:x1875463170557696:12345-192.168.203.3@tcp:35:cat.0 Request processed in 290us (491us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788581514.982668:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1788581515.084565:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581515.084737:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170557952 00000100:00100000:2.0:1788581515.084747:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170557952 00000100:00100000:2.0:1788581515.084818:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1788581515.084828:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+23:15622:x1875463170557952:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1788581515.084852:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581515.084872:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df224fd expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.084978:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.084994:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.085006:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581515.085016:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581515.085152:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224fd expref: 26 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.085176:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224fd expref: 25 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.085185:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581515.085189:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581515.085192:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e400, rc 0) 00000100:00100000:2.0:1788581515.085312:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+25:15622:x1875463170557952:12345-192.168.203.3@tcp:101:dd.0 Request processed in 486us (756us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788581515.085335:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1788581515.094113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581515.094210:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170558080 00000100:00100000:0.0:1788581515.094220:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170558080 00000100:00100000:0.0:1788581515.094310:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1788581515.094321:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+25:15622:x1875463170558080:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1788581515.094343:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581515.094364:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273c00/0x50f0cc74b7b313ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22504 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094401:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094416:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094444:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094623:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273c00/0x50f0cc74b7b313ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 27 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094640:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 26 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.094649:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581515.094652:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581515.094656:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:0.0:1788581515.095999:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+26:15622:x1875463170558080:12345-192.168.203.3@tcp:101:dd.0 Request processed in 1672us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581515.096009:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1788581515.104283:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581515.105522:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170558208 00000100:00100000:0.0:1788581515.105537:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170558208 00000100:00100000:0.0:1788581515.105614:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1788581515.105626:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+26:2396:x1875463170558208:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581515.105642:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581515.105669:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224fd expref: 26 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.105691:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581515.105697:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581515.105752:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+25:2396:x1875463170558208:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 128us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581515.105783:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1788581515.111541:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581515.111876:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170558464 00000100:00100000:3.0:1788581515.111887:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170558464 00000100:00100000:3.0:1788581515.111946:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1788581515.111957:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+25:15622:x1875463170558464:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:3.0:1788581515.112008:0:17063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581515.112046:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b31373 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224e1 expref: 25 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581515.112073:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581515.112078:0:17063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581515.112235:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581515.112249:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581515.112350:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581515.112392:0:17063:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788581515.112412:0:17063:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbd4c968 reply state 000000002a258cf0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581515.112424:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581515.112430:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581515.112433:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581515.112728:0:17063:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581515.112963:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+27:15622:x1875463170558464:12345-192.168.203.3@tcp:36:dd.0 Request processed in 1006us (1429us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788581515.112971:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000020:00080000:3.0:1788581515.112975:0:17063:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581515.262995:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581515.275548:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170558720 00000100:00100000:0.0:1788581515.275568:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170558720 00000100:00100000:0.0:1788581515.275647:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1788581515.275658:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+27:15622:x1875463170558720:12345-192.168.203.3@tcp:35:dd.0 00000100:00100000:3.0:1788581515.276525:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+28:15622:x1875463170558720:12345-192.168.203.3@tcp:35:dd.0 Request processed in 865us (13538us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788581515.276535:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1788581515.552835:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581515.553186:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170558848 00000100:00100000:2.0:1788581515.553197:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170558848 00000100:00100000:2.0:1788581515.553286:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1788581515.553297:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+28:15636:x1875463170558848:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1788581515.553320:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581515.553351:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2250b expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553423:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553437:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553781:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553800:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553809:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553817:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553888:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553905:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.553913:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581515.553954:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788581515.553958:0:20048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581515.554012:0:20048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554298:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554307:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554313:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554319:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554324:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581515.554406:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554415:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554429:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:2.0:1788581515.554439:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581515.554444:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554520:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b313ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554537:0:20048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554543:0:20048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554549:0:20048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554554:0:20048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581515.554557:0:20048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554563:0:20048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554571:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff995d42038b00) 00010000:00010000:2.0:1788581515.554574:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581515.554578:0:20048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554584:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e400/0x50f0cc74b7b313f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554616:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b313e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2250b expref: 30 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554642:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2250b expref: 29 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581515.554648:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581515.554650:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581515.554652:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581515.554774:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+29:15636:x1875463170558848:12345-192.168.203.3@tcp:101:stat.0 Request processed in 1478us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581515.554782:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:0.0:1788581515.686518:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581515.688469:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170559104 00000100:00100000:1.0:1788581515.688483:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170559104 00000100:00100000:1.0:1788581515.688559:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1788581515.688570:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+29:15642:x1875463170559104:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:1.0:1788581515.688642:0:17064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581515.688669:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b313f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2250b expref: 29 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581515.688691:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581515.688696:0:17064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581515.688854:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581515.688868:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581515.688885:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581515.688928:0:17064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788581515.688950:0:17064:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012200d29 reply state 0000000061477c17 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581515.688961:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581515.688967:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581515.688970:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581515.688973:0:17064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581515.689092:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+31:15642:x1875463170559104:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 523us (2581us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788581515.689100:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000020:00080000:1.0:1788581515.689104:0:17064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788581515.841563:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581515.966944:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581515.968591:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170559232 00000100:00100000:0.0:1788581515.968603:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170559232 00000100:00100000:0.0:1788581515.968672:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1788581515.968683:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+31:15656:x1875463170559232:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:0.0:1788581515.968707:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581515.968728:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b31406 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22512 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968803:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968818:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968831:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968843:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968851:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968877:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968952:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968962:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.968968:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581515.969006:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788581515.969011:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581515.969044:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969056:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969065:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969071:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969077:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969082:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581515.969086:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969101:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969114:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:0.0:1788581515.969117:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581515.969123:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969128:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b3140d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969141:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969146:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969151:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969155:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581515.969157:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969162:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969168:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff995d42038b00) 00010000:00010000:0.0:1788581515.969171:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581515.969173:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969191:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31414 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969217:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273200/0x50f0cc74b7b31406 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 33 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969229:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 32 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581515.969236:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581515.969238:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581515.969241:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272400, rc 0) 00000100:00100000:0.0:1788581515.969678:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+32:15656:x1875463170559232:12345-192.168.203.3@tcp:101:stat.0 Request processed in 995us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581515.969687:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1788581516.112032:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581516.112143:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170559488 00000100:00100000:1.0:1788581516.112152:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170559488 00000100:00100000:1.0:1788581516.112239:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00080000:2.0:1788581516.112343:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581516.112545:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+32:15666:x1875463170559488:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581516.112576:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581516.112597:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb200/0x50f0cc74b7b31422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22519 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581516.112688:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788581516.112910:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb200/0x50f0cc74b7b31422 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22519 expref: 34 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.112937:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:1.0:1788581516.112940:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581516.112944:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb200/0x50f0cc74b7b31422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22519 expref: 34 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.112958:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb200, rc 0) 00000100:00100000:1.0:1788581516.113071:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+33:15666:x1875463170559488:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 531us (1057us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788581516.113079:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:1.0:1788581516.127322:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581516.127846:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170559744 00000100:00100000:3.0:1788581516.127872:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170559744 00000100:00100000:3.0:1788581516.127933:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581516.127944:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+33:15666:x1875463170559744:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1788581516.128175:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+34:15666:x1875463170559744:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 232us (867us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788581516.128183:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1788581516.248070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581516.248233:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560000 00000100:00100000:0.0:1788581516.248342:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560000 00000100:00100000:0.0:1788581516.248409:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1788581516.248427:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+34:15672:x1875463170560000:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581516.248451:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581516.248471:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31430 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22520 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248579:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248609:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 35 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248617:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 35 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248626:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248658:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 35 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248672:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 35 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581516.248685:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184261760:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581516.248778:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 35 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.248788:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 35 pid: 17063 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581516.248797:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184261888:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581516.248821:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6be0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581516.264460:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184261760:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581516.264476:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184261888:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581516.264500:0:17065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581516.267499:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581516.267543:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581516.269843:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560128 00000100:00100000:3.0:1788581516.269858:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560128 00010000:00010000:3.0:1788581516.269901:0:20093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 36 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581516.269931:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560256 00000100:00100000:3.0:1788581516.269934:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560256 00010000:00010000:3.0:1788581516.269944:0:20093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 37 pid: 17063 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581516.269975:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581516.269984:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e62527f4-3622-4ebf-800d-388b643273eb+37:2395:x1875463170560128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581516.269998:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581516.270005:0:20093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 37 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270033:0:20093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 37 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270055:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272400/0x50f0cc74b7b3141b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22512 expref: 37 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581516.270079:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:3.0:1788581516.270092:0:20093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00000100:00100000:2.0:1788581516.270093:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+36:2395:x1875463170560256:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581516.270101:0:20093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270106:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581516.270110:0:20093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270116:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 36 pid: 17063 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270121:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581516.270132:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 36 pid: 17063 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270148:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b3135e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df224da expref: 36 pid: 17063 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270188:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00000100:00100000:3.0:1788581516.270193:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e62527f4-3622-4ebf-800d-388b643273eb+35:2395:x1875463170560128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 208us (2701us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581516.270194:0:17048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581516.270207:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00010000:00010000:2.0:1788581516.270210:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270219:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581516.270245:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581516.270298:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+34:2395:x1875463170560256:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 209us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581516.270306:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:3.0:1788581516.270774:0:17065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270783:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581516.270798:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788581516.270912:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272200/0x50f0cc74b7b31430 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 35 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270928:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 34 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.270936:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581516.270939:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581516.270941:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273800, rc 0) 00000100:00100000:3.0:1788581516.270984:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+34:15672:x1875463170560000:12345-192.168.203.3@tcp:101:bash.0 Request processed in 22560us (22924us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788581516.270999:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1788581516.279475:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581516.279600:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560512 00000100:00100000:1.0:1788581516.279610:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560512 00000100:00100000:1.0:1788581516.279684:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1788581516.279696:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+34:15672:x1875463170560512:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1788581516.279914:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.279931:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.279942:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581516.279998:0:17064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788581516.280031:0:17064:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064d786c8 reply state 00000000617ee223 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.280044:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.280052:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581516.280055:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788581516.280058:0:17064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581516.280146:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+37:15672:x1875463170560512:12345-192.168.203.3@tcp:36:bash.0 Request processed in 453us (682us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788581516.280154:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000020:00080000:1.0:1788581516.280159:0:17064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581516.283475:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581516.283700:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560640 00000100:00100000:1.0:1788581516.283710:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560640 00000100:00100000:1.0:1788581516.283767:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1788581516.283777:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+37:15672:x1875463170560640:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581516.283911:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581516.283934:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3144c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22527 expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.283991:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3144c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22527 expref: 38 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.284007:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3144c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22527 expref: 38 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.284648:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581516.284652:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581516.284656:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccba00, rc 0) 00000100:00100000:1.0:1788581516.284716:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+38:15672:x1875463170560640:12345-192.168.203.3@tcp:101:bash.0 Request processed in 939us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581516.284723:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1788581516.295554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581516.295653:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560768 00000100:00100000:1.0:1788581516.295663:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560768 00000100:00100000:1.0:1788581516.295757:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1788581516.295767:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+38:15672:x1875463170560768:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581516.295785:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581516.295803:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca800/0x50f0cc74b7b31453 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2252e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.295885:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.295900:0:17064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 39 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.295908:0:17064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.295941:0:17064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 39 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.295953:0:17064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 39 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581516.295981:0:17064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17064:1875463184262016:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581516.296069:0:17064:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581516.301735:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581516.301830:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170560896 00000100:00100000:3.0:1788581516.301839:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170560896 00010000:00010000:3.0:1788581516.301877:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 40 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581516.301925:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1788581516.301935:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+40:2396:x1875463170560896:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581516.301949:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581516.301956:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 40 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.301969:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 40 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.301995:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581516.302001:0:17048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.302010:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.302027:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.302047:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581516.302102:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+40:2396:x1875463170560896:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 168us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581516.302125:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00010000:00010000:1.0:1788581516.302632:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273800/0x50f0cc74b7b31437 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22520 expref: 39 pid: 17065 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581516.302649:0:17064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17064:1875463184262016:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581516.302670:0:17064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.302678:0:17064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.302683:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581516.302733:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788581516.302737:0:17064:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581516.302814:0:17064:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.302843:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca800/0x50f0cc74b7b31453 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2252e expref: 39 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.302856:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2252e expref: 38 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581516.302863:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581516.302873:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581516.302876:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb800, rc 0) 00000100:00100000:1.0:1788581516.302915:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+38:15672:x1875463170560768:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7148us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581516.302922:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1788581516.305725:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581516.305816:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561152 00000100:00100000:0.0:1788581516.305827:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561152 00000100:00100000:0.0:1788581516.305905:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1788581516.305916:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+38:15672:x1875463170561152:12345-192.168.203.3@tcp:103:bash.0 00010000:00010000:0.0:1788581516.305930:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788581516.305953:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccba00/0x50f0cc74b7b3144c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22527 expref: 38 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.305973:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b3145a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2252e expref: 37 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581516.305982:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581516.305987:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581516.306052:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+36:15672:x1875463170561152:12345-192.168.203.3@tcp:103:bash.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581516.306060:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1788581516.309488:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581516.309744:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561280 00000100:00100000:3.0:1788581516.309753:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561280 00000100:00100000:3.0:1788581516.309816:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1788581516.309827:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+36:15672:x1875463170561280:12345-192.168.203.3@tcp:58:bash.0 00010000:00010000:3.0:1788581516.309922:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.309940:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.309950:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581516.310962:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581516.311166:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788581516.311517:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788581516.311687:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+36:15672:x1875463170561280:12345-192.168.203.3@tcp:58:bash.0 Request processed in 1858us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581516.311697:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1788581516.314766:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581516.314911:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561408 00000100:00100000:3.0:1788581516.314921:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561408 00000100:00100000:3.0:1788581516.314972:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1788581516.314981:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+36:15672:x1875463170561408:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581516.315000:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581516.315042:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22535 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315114:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315124:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 37 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315142:0:17063:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315155:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 37 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315167:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581516.315170:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581516.315174:0:17063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 37 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581516.315181:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980600, rc 0) 00000100:00100000:3.0:1788581516.315233:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+37:15672:x1875463170561408:12345-192.168.203.3@tcp:101:bash.0 Request processed in 253us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581516.315240:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00010000:00010000:3.0:1788581516.870581:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581517.249566:0:17099:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788581517.249645:0:17099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581517.249728:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788581517.249737:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788581517.249859:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f654000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17099:1875463184262144:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581517.250021:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e52c49600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581517.263812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.263886:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f654000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17099:1875463184262144:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581517.264829:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561536 00000100:00100000:1.0:1788581517.264838:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561536 00000100:00100000:1.0:1788581517.264893:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581517.264903:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+37:15674:x1875463170561536:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581517.264930:0:20048:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581517.265780:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+37:15674:x1875463170561536:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 874us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.265789:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581517.282767:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.282933:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561664 00000100:00100000:3.0:1788581517.282944:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561664 00000100:00100000:3.0:1788581517.283016:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1788581517.283036:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+37:15674:x1875463170561664:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788581517.283537:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283556:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283568:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283697:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283706:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283713:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283737:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283745:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283751:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581517.283802:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788581517.283806:0:17063:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581517.283818:0:17063:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283828:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283841:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283847:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283852:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.283857:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283864:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283875:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6625e300) 00010000:00010000:3.0:1788581517.283878:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.283882:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283888:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981e00/0x50f0cc74b7b3146f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283901:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283907:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283912:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283917:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.283925:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283931:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283939:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff995e6f929000) 00010000:00010000:3.0:1788581517.283942:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.283944:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283950:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31476 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283964:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283969:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283974:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283979:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.283982:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283988:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.283996:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581517.283998:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.284018:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.284024:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b3147d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581517.286290:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+37:15674:x1875463170561664:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 3218us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.286305:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1788581517.307316:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.307404:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170561920 00000100:00100000:3.0:1788581517.307414:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170561920 00000100:00100000:2.0:1788581517.307608:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1788581517.307618:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+37:15674:x1875463170561920:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581517.307637:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.307655:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31484 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2253c expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307747:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307761:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307772:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581517.307782:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581517.307846:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307854:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307861:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307866:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581517.307871:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307892:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307904:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581517.307907:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581517.307912:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307918:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b3148b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307960:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31484 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2253c expref: 39 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307970:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6625e300) 00010000:00010000:2.0:1788581517.307972:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581517.307976:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31484 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2253c expref: 39 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.307986:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581517.308057:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+38:15674:x1875463170561920:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 440us (750us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788581517.308065:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1788581517.311955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.312043:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170562048 00000100:00100000:1.0:1788581517.312054:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170562048 00000100:00100000:1.0:1788581517.312107:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1788581517.312117:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+38:15674:x1875463170562048:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581517.312149:0:17064:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581517.312250:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+38:15674:x1875463170562048:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 134us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.312293:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581517.317003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.317096:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170562304 00000100:00100000:2.0:1788581517.317107:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170562304 00000100:00100000:2.0:1788581517.317164:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1788581517.317174:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+38:15674:x1875463170562304:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581517.317208:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.317225:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31499 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22543 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581517.318043:0:17065:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1788581517.318050:0:17065:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788581517.318070:0:17065:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788581517.318198:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b314a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.318212:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b314a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.318223:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b314a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.318582:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31499 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22543 expref: 41 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.318601:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b314a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22543 expref: 40 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.318611:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038d00) 00010000:00010000:2.0:1788581517.318614:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581517.318617:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00000100:00100000:2.0:1788581517.318722:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+40:15674:x1875463170562304:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1548us (1726us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788581517.318730:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1788581517.322799:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.322873:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170562560 00000100:00100000:1.0:1788581517.322882:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170562560 00000100:00100000:1.0:1788581517.322934:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1788581517.322943:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+40:15674:x1875463170562560:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581517.323003:0:17064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581517.323042:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b314a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22543 expref: 40 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323062:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038d00) 00010000:00010000:1.0:1788581517.323070:0:17064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581517.323091:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323102:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323111:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323172:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323179:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323185:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323224:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323231:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323237:0:17064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323248:0:17064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccaa00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.323736:0:17064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323747:0:17064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323757:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581517.323760:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.323764:0:17064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323770:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b314ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323781:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323787:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323794:0:17064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323799:0:17064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.323802:0:17064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323807:0:17064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323824:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc5e7ee8d (ffff995e47fbc100) 00010000:00010000:1.0:1788581517.323826:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.323829:0:17064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.323835:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb000/0x50f0cc74b7b314b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5e7ee8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581517.323912:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+39:15674:x1875463170562560:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 969us (1120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581517.323920:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1788581517.326990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.327064:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170562688 00000100:00100000:2.0:1788581517.327073:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170562688 00000100:00100000:2.0:1788581517.327125:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1788581517.327134:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+39:15674:x1875463170562688:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581517.327152:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.327173:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b314bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2254a expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327203:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ee00/0x50f0cc74b7b314c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327215:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ee00/0x50f0cc74b7b314c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327227:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ee00/0x50f0cc74b7b314c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327366:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b314bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2254a expref: 41 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327385:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ee00/0x50f0cc74b7b314c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2254a expref: 40 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.327403:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:2.0:1788581517.327406:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581517.327409:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ee00, rc 0) 00000100:00100000:2.0:1788581517.327667:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+40:15674:x1875463170562688:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 533us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581517.327675:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1788581517.330930:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.330999:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170562944 00000100:00100000:3.0:1788581517.331016:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170562944 00000100:00100000:3.0:1788581517.331068:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1788581517.331078:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+40:15674:x1875463170562944:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581517.331151:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.331166:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.331177:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581517.331358:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788581517.331368:0:17063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 503473113259ns, next at 504473110792ns, rc = 0 00000004:00010000:3.0:1788581517.331627:0:17063:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7db44fd reply state 00000000e6e4940d transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.331642:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.331664:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:3.0:1788581517.331666:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788581517.331670:0:17063:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581517.331780:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+42:15674:x1875463170562944:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 703us (857us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788581517.331787:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1788581517.335408:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.335489:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563072 00000100:00100000:2.0:1788581517.335499:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563072 00000100:00100000:2.0:1788581517.335559:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1788581517.335569:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+42:15674:x1875463170563072:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581517.335589:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.335608:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22551 expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.335665:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 43 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.335680:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 43 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.335696:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:2.0:1788581517.335700:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581517.335703:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581517.335752:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+43:15674:x1875463170563072:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 185us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581517.335759:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:0.0:1788581517.340929:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.340984:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563200 00000100:00100000:1.0:1788581517.340994:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563200 00000100:00100000:1.0:1788581517.341066:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581517.341082:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170563200:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788581517.341127:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581517.341317:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+6:2396:x1875463170563200:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 240us (397us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788581517.341325:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1788581517.343562:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.343688:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563456 00000100:00100000:1.0:1788581517.343698:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563456 00000100:00100000:1.0:1788581517.343748:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1788581517.343757:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+43:15674:x1875463170563456:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788581517.343983:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e62527f4-3622-4ebf-800d-388b643273eb+44:15674:x1875463170563456:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 226us (428us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788581517.343990:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1788581517.346933:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.347516:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563712 00000100:00100000:1.0:1788581517.347526:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563712 00000100:00100000:1.0:1788581517.347584:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:1.0:1788581517.347594:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+44:15674:x1875463170563712:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581517.347699:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+44:15674:x1875463170563712:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 106us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.347707:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1788581517.351226:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.355207:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563840 00000100:00100000:2.0:1788581517.355222:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563840 00000100:00100000:2.0:1788581517.355476:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1788581517.355487:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+44:15674:x1875463170563840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581517.355506:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.355538:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b314d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22558 expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355618:0:20048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355632:0:20048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355644:0:20048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581517.355683:0:20048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581517.355700:0:20048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355724:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e000/0x50f0cc74b7b314d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22558 expref: 46 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355744:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22558 expref: 45 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.355754:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:2.0:1788581517.355757:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788581517.355760:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:2.0:1788581517.355825:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+45:15674:x1875463170563840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 340us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581517.355833:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:0.0:1788581517.360370:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.360458:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170563968 00000100:00100000:3.0:1788581517.360468:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170563968 00000100:00100000:3.0:1788581517.360523:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1788581517.360533:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:2396:x1875463170563968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581517.360550:0:18570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581517.360568:0:18570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2255f expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581517.360592:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b968d, blocks: 0x0 00010000:00010000:3.0:1788581517.360608:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1788581517.360613:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581517.360622:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 7 pid: 18570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.360639:0:18570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 7 pid: 18570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.360653:0:18570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b000, rc 0) 00000100:00100000:3.0:1788581517.360714:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+7:2396:x1875463170563968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.360721:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1788581517.364403:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.364547:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564224 00000100:00100000:2.0:1788581517.364557:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564224 00000100:00100000:1.0:1788581517.364829:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1788581517.364841:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+45:15674:x1875463170564224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581517.364940:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+45:15674:x1875463170564224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 102us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.364947:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1788581517.368018:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.368103:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564352 00000100:00100000:1.0:1788581517.368112:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564352 00000100:00100000:1.0:1788581517.368196:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1788581517.368206:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+45:15674:x1875463170564352:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788581517.370495:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788581517.370509:0:17043:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788581517.370565:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370584:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370593:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370600:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fc00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.370605:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370620:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370638:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff995d42038500) 00010000:00010000:1.0:1788581517.370642:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.370646:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370653:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0fc00/0x50f0cc74b7b312a8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370675:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370682:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370688:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.370693:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f400 already unused, calling callback (ffffffffc1a714f0) 00000001:00080000:0.0:1788581517.370717:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788581517.370756:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184262272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788581517.370818:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581517.370850:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184262272 00000100:00100000:0.0:1788581517.370857:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184262272 00000100:00100000:0.0:1788581517.370901:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581517.370909:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e44b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184262272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788581517.371035:0:19464:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788581517.371039:0:19464:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788581517.371041:0:19464:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788581517.371043:0:19464:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788581517 -> 1788581517 00002000:00010000:0.0:1788581517.371045:0:19464:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788581517.371076:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e44b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184262272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (258us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788581517.371094:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788581517.371126:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371135:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371147:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:1.0:1788581517.371150:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.371154:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371230:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f400/0x50f0cc74b7b312af lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371246:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371284:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371291:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371297:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.371301:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371308:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371317:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff995d42038b00) 00010000:00010000:1.0:1788581517.371320:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:0.0:1788581517.371321:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e7f657480/2, rc 0, transno 8589934596 00010000:00010000:1.0:1788581517.371324:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.371330:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184262272:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788581517.371333:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f800/0x50f0cc74b7b31357 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371353:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371360:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371372:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371378:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.371381:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.371397:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371493:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371504:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371510:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371515:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.371518:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371524:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371534:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:3.0:1788581517.371537:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788581517.371540:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.371546:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb600/0x50f0cc74b7b312fc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788581517.371740:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581517.371836:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+18:15674:x1875463170564352:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 3629us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581517.371844:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:1.0:1788581517.372031:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581517.372034:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.372038:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372045:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b313dc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372057:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372063:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372070:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372074:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccae00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.372077:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372093:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372102:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581517.372104:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.372107:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372113:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccae00/0x50f0cc74b7b313ff lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372122:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372128:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372133:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372138:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.372141:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372148:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372154:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:1.0:1788581517.372155:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581517.372218:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372235:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42cca000/0x50f0cc74b7b31445 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372247:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372347:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372354:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372359:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581517.372362:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372369:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372377:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:1.0:1788581517.372379:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788581517.372383:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.372389:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b314ca lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.374691:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.374761:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564480 00000100:00100000:3.0:1788581517.374769:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564480 00000100:00100000:3.0:1788581517.374819:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1788581517.374828:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+7:2396:x1875463170564480:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788581517.374926:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+7:2396:x1875463170564480:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.374933:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1788581517.377807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.378054:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564736 00000100:00100000:3.0:1788581517.378063:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564736 00000100:00100000:3.0:1788581517.378124:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1788581517.378133:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+14:15674:x1875463170564736:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581517.378182:0:17063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581517.378205:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b314df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22558 expref: 14 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.378227:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:3.0:1788581517.378232:0:17063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581517.378281:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.378302:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.378311:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581517.378443:0:17063:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f52df64 reply state 000000004ae14067 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.378456:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.378462:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:3.0:1788581517.378476:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581517.378479:0:17063:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581517.378561:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+15:15674:x1875463170564736:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 428us (761us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788581517.378568:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1788581517.381045:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.381111:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564864 00000100:00100000:3.0:1788581517.381120:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564864 00000100:00100000:3.0:1788581517.381170:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1788581517.381179:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+7:15674:x1875463170564864:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581517.381194:0:18570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581517.381209:0:18570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22566 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.381236:0:18570:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 8 pid: 18570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.381244:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581517.381249:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581517.381277:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 8 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.381322:0:18570:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 8 pid: 18570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.381336:0:18570:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 8 pid: 18570 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581517.381370:0:18570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18570:1875463184262400:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581517.381447:0:18570:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788581517.384502:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.384609:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170564992 00000100:00100000:2.0:1788581517.384618:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170564992 00010000:00010000:2.0:1788581517.384653:0:17048:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 9 pid: 18570 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581517.384691:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1788581517.384699:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+9:2396:x1875463170564992:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581517.384712:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581517.384731:0:17048:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 9 pid: 18570 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.384745:0:17048:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 9 pid: 18570 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.384767:0:17048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581517.384771:0:17048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581517.384778:0:17048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.384788:0:17048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.384841:0:17048:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581517.384855:0:17048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17048:1875463184262528:192.168.203.3@tcp:105: 00000100:00100000:2.0:1788581517.384926:0:17048:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512e6480 going to sleep for 11 seconds 00010000:00010000:3.0:1788581517.385480:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057108f0f/0x50f0cc74b7b314e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2255f expref: 9 pid: 18570 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581517.385495:0:18570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18570:1875463184262400:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581517.385515:0:18570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 8 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.385526:0:18570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a000, rc 0) 00000100:00100000:3.0:1788581517.385565:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+8:15674:x1875463170564864:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 4387us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.385573:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581517.390101:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.390208:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565120 00000100:00100000:1.0:1788581517.390217:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565120 00000100:00100000:1.0:1788581517.390282:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1788581517.390301:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+8:2395:x1875463170565120:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581517.390460:0:19464:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788581517.390464:0:19464:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788581516 00002000:00010000:1.0:1788581517.390466:0:19464:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788581514 00002000:00010000:1.0:1788581517.390468:0:19464:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788581517 -> 1788581516 00002000:00010000:1.0:1788581517.390470:0:19464:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788581517.390521:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+9:2395:x1875463170565120:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 222us (432us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788581517.390529:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1788581517.390739:0:17048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17048:1875463184262528:192.168.203.3@tcp:105: 00010000:00010000:2.0:1788581517.390760:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581517.390784:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e62527f4-3622-4ebf-800d-388b643273eb+8:2396:x1875463170564992:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6085us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581517.390799:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581517.393099:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.394041:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565248 00000100:00100000:3.0:1788581517.394051:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565248 00000100:00100000:1.0:1788581517.394155:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1788581517.394178:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+8:2393:x1875463170565248:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788581517.394220:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.394242:0:18571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 8 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.394280:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581517.394285:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581517.394290:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.394331:0:18571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 8 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.394363:0:18571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 8 pid: 18570 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581517.394379:0:18571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18571:1875463184262656:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581517.394788:0:18571:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581517.397169:0:18571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18571:1875463184262656:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581517.397196:0:18571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581517.399315:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581517.399599:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565376 00000100:00100000:0.0:1788581517.399609:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565376 00010000:00010000:0.0:1788581517.399644:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.399684:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1788581517.399693:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+9:2395:x1875463170565376:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581517.399705:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581517.399726:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.399741:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.399775:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008379cfc2/0x50f0cc74b7b314f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22566 expref: 9 pid: 18570 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.399792:0:17050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581517.399796:0:17050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581517.399802:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.399812:0:17050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.399889:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581517.399946:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+8:2395:x1875463170565376:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 252us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581517.399953:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00010000:00010000:3.0:1788581517.401116:0:18571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401131:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401155:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401178:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401186:0:18571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401193:0:18571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581517.401197:0:18571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401206:0:18571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401223:0:18571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.401230:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008200606c/0x50f0cc74b7b314fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.401680:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e62527f4-3622-4ebf-800d-388b643273eb+7:2393:x1875463170565248:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 7501us (8583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581517.401690:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1788581517.406205:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.407067:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565632 00000100:00100000:2.0:1788581517.407079:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565632 00000100:00100000:1.0:1788581517.408865:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1788581517.408888:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+15:15674:x1875463170565632:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788581517.408970:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.408992:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 15 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.409002:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.409046:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 15 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.409079:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 15 pid: 17065 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581517.409094:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184262784:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581517.409177:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581517.419442:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.420562:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184262784:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581517.420590:0:17065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.420812:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565760 00000100:00100000:0.0:1788581517.420819:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565760 00010000:00010000:0.0:1788581517.420853:0:20093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 16 pid: 17065 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581517.420893:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:0.0:1788581517.420901:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e62527f4-3622-4ebf-800d-388b643273eb+16:2395:x1875463170565760:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581517.420932:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581517.420941:0:20093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 16 pid: 17065 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.420952:0:20093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 16 pid: 17065 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.420984:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43272000/0x50f0cc74b7b313d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22504 expref: 16 pid: 17065 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.420999:0:20093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:0.0:1788581517.421012:0:20093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 15 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.421022:0:20093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.421029:0:20093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.421034:0:20093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581517.421063:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581517.421129:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e62527f4-3622-4ebf-800d-388b643273eb+15:2395:x1875463170565760:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 219us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581517.421144:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:1.0:1788581517.421379:0:17065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421387:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421816:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421830:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 15 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421838:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421866:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 15 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.421893:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 15 pid: 20048 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581517.421916:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184262912:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581517.423023:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f252180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581517.430743:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.430835:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170565888 00000100:00100000:3.0:1788581517.430845:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170565888 00010000:00010000:3.0:1788581517.430881:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 16 pid: 20048 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581517.430916:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1788581517.430937:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+16:2396:x1875463170565888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581517.430952:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581517.430958:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 16 pid: 20048 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.430972:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 16 pid: 20048 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.430993:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:3.0:1788581517.430998:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.431018:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.431026:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.431043:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581517.431094:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e62527f4-3622-4ebf-800d-388b643273eb+16:2396:x1875463170565888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.431101:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00010000:00010000:2.0:1788581517.432105:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b314d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22551 expref: 15 pid: 20048 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581517.432127:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184262912:192.168.203.3@tcp:104: 00010000:00010000:2.0:1788581517.432148:0:17065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.432157:0:17065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.432163:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581517.432347:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788581517.432494:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788581517.432541:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788581517.432617:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17065:1875463184263040:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788581517.432669:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581517.432696:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581517.434792:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263040 00000100:00100000:3.0:1788581517.434804:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263040 00000100:00100000:3.0:1788581517.434866:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788581517.434875:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17065:x1875463184263040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788581517.434985:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17065:x1875463184263040:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.434992:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581517.436790:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17065:1875463184263040:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788581517.436997:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788581517.437091:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17065:1875463184263168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788581517.437829:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581517.437870:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581517.438108:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263168 00000100:00100000:3.0:1788581517.438116:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263168 00000100:00100000:0.0:1788581517.438594:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581517.438607:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17065:x1875463184263168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788581517.438976:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17065:x1875463184263168:12345-0@lo:1000:mdt00_002.0 Request processed in 365us (1140us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788581517.438984:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581517.439058:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17065:1875463184263168:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788581517.439102:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439112:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439120:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439125:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581517.439129:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439148:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439164:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:2.0:1788581517.439167:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581517.439179:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439185:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb400/0x50f0cc74b7b31509 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439215:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439222:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439227:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439233:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581517.439236:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439243:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439561:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581517.439567:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581517.439574:0:17065:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 18 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439586:0:17065:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 18 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439595:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 18 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.439664:0:17065:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 18 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581517.439678:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184263296:192.168.203.3@tcp:105: 00000100:00100000:2.0:1788581517.440016:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422aacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581517.451959:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.452056:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17065:1875463184263296:192.168.203.3@tcp:105: 00010000:00010000:2.0:1788581517.452083:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452094:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31461 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452123:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452137:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452149:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452159:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452165:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452173:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452195:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581517.452199:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452206:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452219:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581517.452222:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581517.452226:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452231:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31510 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452242:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452249:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452290:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452295:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccaa00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581517.452299:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452304:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452322:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581517.452325:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581517.452329:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.452335:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccaa00/0x50f0cc74b7b31502 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581517.452496:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+18:15674:x1875463170565632:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 43617us (46297us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788581517.452507:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000020:00080000:2.0:1788581517.452513:0:17065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788581517.452551:0:17099:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581517.452557:0:17099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581517.452574:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788581517.452580:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788581517.453122:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170566016 00000100:00100000:3.0:1788581517.453130:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170566016 00000100:00100000:3.0:1788581517.453172:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581517.453181:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+18:15672:x1875463170566016:12345-192.168.203.3@tcp:49:bash.0 00000100:00100000:3.0:1788581517.453297:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+18:15672:x1875463170566016:12345-192.168.203.3@tcp:49:bash.0 Request processed in 116us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.453304:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1788581517.456990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.457071:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170566272 00000100:00100000:3.0:1788581517.457080:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170566272 00000100:00100000:3.0:1788581517.457129:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1788581517.457138:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+18:15674:x1875463170566272:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788581517.457404:0:17067:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788581517.457433:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788581517.457465:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457480:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457490:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457498:0:17067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457505:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457528:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457548:0:17067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581517.457635:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+20:15674:x1875463170566272:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 497us (652us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788581517.457642:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000020:00080000:3.0:1788581517.457647:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788581517.457664:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581517.457670:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457675:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581517.457680:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457688:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457699:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:3.0:1788581517.457702:0:17051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788581517.457706:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457712:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31517 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.457722:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581517.457723:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581517.457725:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581517.460221:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581517.460506:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170566400 00000100:00100000:1.0:1788581517.460516:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170566400 00000100:00100000:1.0:1788581517.460756:0:19467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581517.460767:0:19467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+7:15672:x1875463170566400:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1788581517.460783:0:19467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581517.460801:0:19467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006587fa02/0x50f0cc74b7b3151e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2256d expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581517.460825:0:19467:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b968c, atime: 0x6a9b968a, ctime: 0x6a9b968c, blocks: 0x0 00010000:00010000:1.0:1788581517.460843:0:19467:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1788581517.460847:0:19467:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581517.460856:0:19467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006587fa02/0x50f0cc74b7b3151e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2256d expref: 8 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.460870:0:19467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006587fa02/0x50f0cc74b7b3151e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2256d expref: 8 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581517.460882:0:19467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccbc00, rc 0) 00000100:00100000:1.0:1788581517.460939:0:19467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+8:15672:x1875463170566400:12345-192.168.203.3@tcp:101:bash.0 Request processed in 174us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.460960:0:19467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581517.464830:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.464990:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170566528 00000100:00100000:3.0:1788581517.464999:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170566528 00000100:00100000:3.0:1788581517.465059:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1788581517.465068:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+20:15672:x1875463170566528:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1788581517.465090:0:17063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581517.465107:0:17063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31525 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22574 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465138:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3152c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465151:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3152c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465162:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3152c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465304:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31525 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22574 expref: 22 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465328:0:17063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3152c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22574 expref: 21 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.465336:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581517.465339:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581517.465342:0:17063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:3.0:1788581517.465609:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+21:15672:x1875463170566528:12345-192.168.203.3@tcp:101:bash.0 Request processed in 541us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.465617:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1788581517.475070:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.475155:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170566784 00000100:00100000:3.0:1788581517.475165:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170566784 00000100:00100000:3.0:1788581517.475219:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1788581517.475230:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+21:15672:x1875463170566784:12345-192.168.203.3@tcp:35:bash.0 00000001:00080000:2.0:1788581517.475837:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788581517.475915:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788581517.476021:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+24:15672:x1875463170566784:12345-192.168.203.3@tcp:35:bash.0 Request processed in 791us (959us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788581517.476029:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000020:00080000:2.0:1788581517.476034:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788581517.624991:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.625083:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567040 00000100:00100000:2.0:1788581517.625093:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567040 00000100:00100000:2.0:1788581517.625145:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581517.625155:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+24:15684:x1875463170567040:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581517.625179:0:20048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581517.625196:0:20048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2257b expref: -99 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581517.625348:0:20048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788581517.625454:0:20048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31533 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2257b expref: 26 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.625468:0:20048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:2.0:1788581517.625472:0:20048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581517.625476:0:20048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2257b expref: 26 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581517.625492:0:20048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581517.625549:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+25:15684:x1875463170567040:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 395us (565us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788581517.625556:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581517.628850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581517.628922:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567168 00000100:00100000:3.0:1788581517.628931:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567168 00000100:00100000:3.0:1788581517.628981:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:3.0:1788581517.628991:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+25:15684:x1875463170567168:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1788581517.629068:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629084:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629095:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629109:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629115:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629121:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629195:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629203:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629233:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581517.629321:0:17063:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629333:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629339:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629346:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629352:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.629356:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629363:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629374:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:3.0:1788581517.629377:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.629382:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629388:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b000/0x50f0cc74b7b31541 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629399:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629410:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629416:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629421:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6bc00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.629424:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629430:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629438:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff995e6f929000) 00010000:00010000:3.0:1788581517.629441:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.629443:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629449:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6bc00/0x50f0cc74b7b31548 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629461:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629466:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629472:0:17063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629478:0:17063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581517.629485:0:17063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629492:0:17063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629498:0:17063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:3.0:1788581517.629500:0:17063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581517.629503:0:17063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581517.629509:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a400/0x50f0cc74b7b3154f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581517.629574:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e62527f4-3622-4ebf-800d-388b643273eb+25:15684:x1875463170567168:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 583us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581517.629585:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1788581517.633670:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581517.633694:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184263424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581517.633757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581517.633919:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263424 00000100:00100000:1.0:1788581517.633927:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263424 00000100:00100000:1.0:1788581517.633988:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581517.633998:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184263424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581517.634034:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581517.634087:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184263424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581517.634094:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788581517.634209:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581517.634585:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184263424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581517.636146:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581517.636239:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567424 00000100:00100000:2.0:1788581517.636247:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567424 00000100:00100000:2.0:1788581517.637181:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1788581517.637197:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+25:15684:x1875463170567424:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1788581517.638846:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+26:15684:x1875463170567424:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 1644us (2698us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788581517.638858:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00010000:00010000:1.0:1788581517.889426:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581518.055651:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.055691:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.055721:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.055751:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.055775:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567808 00000100:00100000:0.0:1788581518.055782:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567808 00000100:00100000:0.0:1788581518.055827:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568320 00000100:00100000:0.0:1788581518.055830:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568320 00000100:00100000:0.0:1788581518.055851:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1788581518.055859:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e62527f4-3622-4ebf-800d-388b643273eb+5:2394:x1875463170567808:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581518.055916:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e62527f4-3622-4ebf-800d-388b643273eb+5:2394:x1875463170567808:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.055924:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1788581518.055939:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581518.055945:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568320:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581518.055963:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568320:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 19us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.055983:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1788581518.056044:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.056097:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581518.056311:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581518.056525:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568192 00000100:00100000:3.0:1788581518.056529:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568192 00000100:00100000:3.0:1788581518.056564:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581518.056571:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568192:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581518.056603:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568192:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581518.056609:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581518.056625:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568064 00000100:00100000:3.0:1788581518.056628:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568064 00000100:00100000:3.0:1788581518.056648:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567680 00000100:00100000:3.0:1788581518.056650:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567680 00000100:00100000:3.0:1788581518.056659:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567936 00000100:00100000:3.0:1788581518.056661:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567936 00000100:00100000:3.0:1788581518.056683:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1788581518.056688:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568064:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581518.056713:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2394:x1875463170568064:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581518.056719:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1788581518.056728:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1788581518.056733:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2394:x1875463170567680:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581518.056749:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2394:x1875463170567680:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 17us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581518.056755:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1788581518.056763:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1788581518.056817:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2394:x1875463170567936:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581518.056843:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2394:x1875463170567936:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581518.056849:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1788581518.056990:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170567552 00000100:00100000:2.0:1788581518.056994:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170567552 00000100:00100000:2.0:1788581518.057049:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:2.0:1788581518.057056:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2394:x1875463170567552:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581518.057103:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2394:x1875463170567552:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.057108:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00080000:2.0:1788581518.057132:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581518.057136:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581518.057138:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581518.057150:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581518.145414:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581518.145440:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184263680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581518.145461:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184263552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581518.145507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581518.145598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.145665:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263680 00000100:00100000:1.0:1788581518.145673:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263680 00000100:00100000:1.0:1788581518.145715:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263552 00000100:00100000:1.0:1788581518.145718:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263552 00000100:00100000:1.0:1788581518.145732:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581518.145740:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184263680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581518.145768:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788581518.145825:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184263680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581518.145832:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581518.145850:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581518.145855:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184263552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581518.145870:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581518.145898:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184263552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581518.145915:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581518.145950:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184263552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581518.146085:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184263680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581518.658178:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184264064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658280:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658313:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184264576:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658340:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658380:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658401:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788581518.658407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184263936:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658448:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184264448:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658485:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658498:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184264960:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581518.658558:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264576 00000100:00100000:2.0:1788581518.658565:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264576 00000100:00100000:2.0:1788581518.658611:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265088 00000100:00100000:2.0:1788581518.658615:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265088 00000100:00100000:2.0:1788581518.658639:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264960 00000100:00100000:2.0:1788581518.658641:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264960 00000100:00100000:2.0:1788581518.658669:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581518.658677:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184264576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658727:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184264576:12345-0@lo:400:kworker.0 Request processed in 51us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.658734:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581518.658750:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581518.658756:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658782:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184265088:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.658788:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581518.658799:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581518.658805:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184264960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658831:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184264960:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.658837:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788581518.658853:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581518.658857:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581518.658881:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184264960:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.658892:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184264576:0@lo:400:kworker.0 00010000:00080000:2.0:1788581518.658903:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e4f274380 x1875463184265088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581518.658912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184265088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659165:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184264192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.659236:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184264704:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659280:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.659298:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788581518.659304:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184263808:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.659355:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184264320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659378:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.659393:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4f277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659411:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.659432:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263808 00000100:00100000:1.0:1788581518.659436:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263808 00000100:00100000:1.0:1788581518.659463:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788581518.659470:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184263808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.659502:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184263808:12345-0@lo:400:kworker.0 Request processed in 33us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581518.659509:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788581518.659566:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184263808:0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.659850:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264064 00000100:00100000:0.0:1788581518.659855:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264064 00000100:00100000:0.0:1788581518.659883:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184263936 00000100:00100000:0.0:1788581518.659886:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184263936 00000100:00100000:0.0:1788581518.659909:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264448 00000100:00100000:0.0:1788581518.659913:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264448 00000100:00100000:0.0:1788581518.659926:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264320 00000100:00100000:0.0:1788581518.659929:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264320 00000100:00100000:0.0:1788581518.659942:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581518.659949:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184264064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.659989:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1875463184264064:12345-0@lo:400:kworker.0 Request processed in 41us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.659995:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581518.660022:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581518.660028:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184263936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.660056:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184263936:12345-0@lo:400:kworker.0 Request processed in 28us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.660061:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581518.660073:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581518.660078:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184264448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.660120:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184264448:12345-0@lo:400:kworker.0 Request processed in 42us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.660127:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581518.660139:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581518.660145:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184264320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.660170:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184264320:12345-0@lo:400:kworker.0 Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.660176:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788581518.660366:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581518.660370:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581518.660396:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184263936:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660417:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184264448:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660441:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184264064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660469:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264192 00000100:00100000:2.0:1788581518.660473:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264192 00000100:00100000:2.0:1788581518.660491:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264704 00000100:00100000:2.0:1788581518.660493:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264704 00000100:00100000:2.0:1788581518.660529:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184264832 00000100:00100000:2.0:1788581518.660533:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184264832 00000100:00100000:2.0:1788581518.660549:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581518.660555:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660589:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184264192:12345-0@lo:400:kworker.0 Request processed in 35us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.660595:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581518.660606:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581518.660612:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184264704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660636:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184264704:12345-0@lo:400:kworker.0 Request processed in 25us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.660641:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581518.660653:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581518.660658:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184264832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581518.660683:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184264832:12345-0@lo:400:kworker.0 Request processed in 25us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581518.660688:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788581518.660848:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581518.660852:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581518.661343:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581518.661382:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581518.661446:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184264320:0@lo:400:kworker.0 00010000:00080000:1.0:1788581518.661461:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e4f277b80 x1875463184264832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581518.661470:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.661481:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184264192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581518.661490:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4f274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184264704:0@lo:400:kworker.0 00000100:00100000:0.0:1788581518.661649:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265216 00000100:00100000:0.0:1788581518.661655:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265216 00000100:00100000:0.0:1788581518.661696:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581518.661704:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875463184265216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581518.661726:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581518.661765:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875463184265216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.661771:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581518.661833:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581518.662705:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581518.662718:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184265472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581518.662761:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581518.662762:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184265344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581518.662804:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581518.662838:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265472 00000100:00100000:0.0:1788581518.662844:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265472 00000100:00100000:0.0:1788581518.662866:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265344 00000100:00100000:0.0:1788581518.662868:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265344 00000100:00100000:0.0:1788581518.662879:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581518.662885:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184265472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581518.662908:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788581518.662948:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184265472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.662955:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581518.662967:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581518.662975:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184265344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581518.662984:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581518.663020:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184265472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581518.663028:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184265344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581518.663035:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581518.663058:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184265344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788581518.917051:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581519.444167:0:20243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:0.0:1788581519.490387:0:17099:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581519.490396:0:17099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581519.490416:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788581519.490432:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788581519.938680:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581520.623490:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581520.623621:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581520.623661:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568576 00000100:00100000:3.0:1788581520.623670:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568576 00000100:00100000:3.0:1788581520.623722:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581520.623731:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e62527f4-3622-4ebf-800d-388b643273eb+8:2393:x1875463170568576:12345-192.168.203.3@tcp:16:kworker.0 00000100:00100000:3.0:1788581520.623843:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e62527f4-3622-4ebf-800d-388b643273eb+8:2393:x1875463170568576:12345-192.168.203.3@tcp:16:kworker.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581520.623851:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00080000:3.0:1788581520.623874:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581520.624510:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568448 00000100:00100000:0.0:1788581520.624515:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568448 00002000:00100000:0.0:1788581520.624555:0:18575:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff995d423e5500 x1875463170568448/t0(0) o4->e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp:121/0 lens 504/0 e 0 to 0 dl 1788581531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788581520.624566:0:18575:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d423e5500 with x1875463170568448 ext(0->8) 00002000:00010000:0.0:1788581520.624572:0:18575:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d423e5500 00000100:00100000:0.0:1788581520.624590:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581520.624597:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e62527f4-3622-4ebf-800d-388b643273eb+8:2393:x1875463170568448:12345-192.168.203.3@tcp:4:bash.0 00000100:00100000:0.0:1788581520.626361:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e62527f4-3622-4ebf-800d-388b643273eb+10:2393:x1875463170568448:12345-192.168.203.3@tcp:4:bash.0 Request processed in 1756us (2872us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788581520.626373:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:0.0:1788581520.626392:0:18575:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff995d423e5500 x1875463170568448/t8589934599(0) o4->e62527f4-3622-4ebf-800d-388b643273eb@192.168.203.3@tcp:121/0 lens 504/448 e 0 to 0 dl 1788581531 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788581520.626402:0:18575:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff995d423e5500 with x1875463170568448 ext(0->8) 00002000:00010000:0.0:1788581520.626407:0:18575:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff995d423e5500 00010000:00010000:3.0:1788581520.961623:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42249 lines, 42249 kept, 0 dropped, 0 bad.